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Preface 



First-degree or, to use the generally accepted term, linear inequal- 
ities are inequalities of the form 

ax + by + c ^ 

(for simplicity we have written an inequality in two unknowns x 
and y). The theory of systems of linear inequalities is a small but 
most fascinating branch of mathematics. Interest in it is to a consider- 
able extent due to the beauty of geometrical content, for in geomet- 
rical terms giving a system of linear inequalities in two or three un- 
knowns means giving a convex polygonal region in the plane or a 
convex polyhedral solid in space, respectively. For example, the 
study of convex polyhedra, a part of geometry as old as the hills, 
turns thereby into one of the chapters of the theory of systems of 
linear inequalities. This theory has also some branches which are 
near the algebraist's heart; for example, they include a remarkable 
analogy between the properties of linear inequalities and those of 
systems of linear equations (everything connected with linear equations 
has been studied for a long time and in much detail). 

Until recently one might think that linear inequalities would for- 
ever remain an object of purely mathematical work. The situation 
has changed radically since the mid 40s of this century when there 
arose a new area of applied mathematics — linear programming — 
with important applications in the economy and engineering. Linear 
programming is in the end nothing but a part (though a very impor- 
tant one) of the theory of systems of linear inequalities. 

It is exactly the aim of this small book to acquaint the reader 
with the various aspects of the theory of systems of linear inequali- 
ties, viz. with the geometrical aspect of the matter and some of the 
methods for solving systems connected with that aspect, with certain 
purely algebraic properties of the systems, and with questions of 
linear programming. Reading the book will not require any know- 
ledge beyond the school course in mathematics. 

A few words are in order about the history of the questions to 
be elucidated in this book. 

Although by its subject-matter the theory of linear inequalities 
should, one would think, belong to the most basic and elementary 
parts of mathematics, until recently it was studied relatively little. 
From the last years of the last century works began occasionally to 
appear which elucidated some properties of systems of linear inequal- 
ities. In this connection one can mention the names of such mathe- 



maticians as H. Minkowski (one of the greatest geometers of the 
end of the last and the beginning of this century especially well 
known for his works on convex sets and as the creator of "Minkow- 
skian geometry"), G.F. Voronoi (one of the fathers of the "Pe- 
tersburg school of number theory"), A. Haar (a Hungarian mathe- 
matician who won recognition for his works on "group integration"), 
Hi'Weyl (one of the most outstanding mathematicians of the first half 
of this century; one can read about his hfe and work in the pamph- 
let "Herman Weyl" by I. M. Yaglom, Moscow, "Znanie", 1967). 
Some of the results obtained by them are to some extent or other ref- 
lected in the present book (though without mentioning the authors' 
names). 

It was not until the 1940s or 1950s, when the rapid growth of applied 
disciplines (linear, convex and other modifications of "mathematical 
programming", the so-called "theory of games", etc.) made an advanced 
and systematic study of linear inequalities a necessity, that a really 
intensive development of the theory of systems of linear inequali- 
ties began. At present a complete list of books and papers on inequal- 
ities would probably contain hundreds of titles. 



1. Some Facts from Analytic Geometry 

f. Operations on points. Consider a plane with a rectangular coordi- 
nate system. The fact that a point M has coordinates x and y in 
this system is written down as follows: 

M = (x, y) or simply M(x, y) 

The presence of a coordinate system allows one to perform some 
operations on the points of the plane, namely the operation of 
addition of points and the operation of multiplication of a point by a 
number. 

The addition of points is defined in the following way: if M t = 
(xj, y,) and M 2 = (x 2 , y 2 ), then 

M l +M 2 = (xj + x 2 , y, + y 2 ) 

» 
Thus the addition of points is reduced to the addition of their 
similar coordinates. 

The visualization of this operation is very simple (Fig. 1); the 
point M t + M 2 is the fourth vertex of the parallelogram construc- 
ted on the segments OM t and OM 2 as its sides (0 is the origin of 
coordinates). M,, O, M 2 are the three remaining vertices of the 
parallelogram. 
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The same can be said in another way: the point Mj +M 2 is 
obtained by translating the point M 2 in the direction of the segment 
OMi over a distance equal to the length of the segment. 

The multiplication of the point M(x,y) by an arbitrary number 
k is carried out according to the following rule: 

kM = (/ex, ky) 
The visualization of this operation is still simpler than that of the 
addition; for k > the point M' = kM lies on the ray OM, with 




Fig. 1 

OM' = k x OM; for k < the point M' lies on the extension of 
the ray OM beyond the point 0, with OM' = \k\ x OM (Fig. 2). 
The derivation of the above visualization of both operations 
will provide a good exercise for the reader*. 




*kM(k<0) 
Fig. 2 



The operations we have introduced are very convenient to use 
in interpreting geometric facts in terms of algebra. We cite some 
examples to show this. 



* Unless the reader is familiar with the fundamentals of vector theory. 
In vector terms our operations are known to _mean the following: 
the point Mi + M 2 is the end of_the vector OM, + OM 2 and the point kM 

is the end of the vector k x OM (on condition that the point is the 
beginning of this vector). 



(1) The segment MyM 2 consists of all points of the form 

s 1 M 1 + s 2 M 2 

where s l , s 2 are any two nonnegative numbers the sum of which 
equals 1. 

Here a purely geometric fact, the belonging of a point to the 
segment M,M 2 , is written in the form of the algebraic relation 
M = SiMj + s 2 M 2 with the above constraints on s u s 2 . 





Fig. 3 Fig. 4 



To prove the above, consider an arbitrary point M on the 
segment M l M 2 - Drawing through M straight lines parallel to OM 2 
and OMi we obtain the point N t on the segment 0M X and the 
point N 2 on the segment OM 2 (Fig. 3). Let 

M 2 M M t M 



>i ~ \l »-» ' "2 



M 2 M^ '* MiM 2 

the numbers s t and s 2 being nonnegative and their sum equalling 1. 
From the similarity of the corresponding triangles we find 

ONi M 2 M ON 2 M t M 

OMi = M 2 M, = Sl ' ~OM 2 = M t M 2 = S * 

which yields N t — SiM t , N 2 = s 2 M 2 . But M=N t +N 2 , hence 
M = .s'iMj + s 2 M 2 . We, finally, remark that when the point M 
runs along the segment M 1 M 2 in the direction from M^ toward 
M 2 , the number s 2 runs through all the values from to 1. 
Thus proposition (1) is proved. 

(2) Any point M of the straight line M X M 2 can be represented as 

tM Y + (1 - t)M 2 

where t is a number. 
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In fact, if the point M lies on the segment M^M 2 , then our 
statement follows from that proved above. Let M lie outside of 
the segment M t M 2 . Then either the point My lies on the segment 
MM 2 (as in Fig. 4) or M 2 lies on the segment MM,. Suppose, 
for example, that the former is the case. Then, from what has 
been proved, 

M ! = sM + (1 - s)M 2 (0 < s < 1) 



A+sB^ 





Fig. 5 



Hence 






Fig. 6 



M 2 = tM i +(1 -t)M 2 



where t = 1/s. Let the case where M 2 lies on the segment MMy 
be considered by the reader. 

(3) When a parameter s increases from to oo, the point sB 
runs along the ray OB* and the point A + sB is the ray emerging 
from A in the direction of OB. When s decreases from to — oo, 
the points sB and A + sB run along the rays that are supplementary 
to those indicated above. To establish this, it is sufficient to look 
at Figs. 5 and 6. 

It follows from proposition (3) that, as s changes from 
— oo to +oo, the point A + sB runs along the straight line 
passing through A and parallel to OB. 

The operations of addition and multiplication by a number can, 
of course, be performed on points in space as well. In that case, 



* The point B is supposed to be different from the origin of coor- 
dinates O. 

11 



by definition, 

M 1 + M 2 = (xj + x 2 , y>i + y 2 , z x + z 2 ) 
kM = (kx, ky, kz) 

All the propositions proved above will obviously be true for 
space as well. 

We conclude this section by adopting a convention which will 
later help us formulate many facts more clearly and laconically. 
Namely, if .iC and Z£ are some two sets of points (in the plane 
or in space), then we shall agree to understand by their "sum" 
.yf + y a set of all points of the form K + L where K is an 
arbitrary point in Jf" and L an arbitrary point in if. 





Fig. 7 Fig. 8 

Special notation has been employed in mathematics for a long 
time to denote the belonging of a point to a given set; namely, 
in order to indicate that a point M belongs to a set M one 
writes MeJl (the symbol e standing for the word "belongs"). 
So JT + if is a set of all points of the form K + L where 
KeJf and Le<£. 

From the visualization of the addition of points a simple rule 
for the addition of the point sets ;$C and ££ can be given. 
This rule is as follows. For each point KeJf a set must he 
constructed which is a result of translating Z£ along the segment 
OK over a distance equal to the length of the segment and 
then all sets obtained in this way must be united into one. It is 
the latter that will be Jf + if. 

We shall cite some examples. 

1. Let a set JT consist of a single point K whereas £f is any 
set of points. The set K + Z£ is a result of translating the set if 
along the segment OK over a distance equal to its length (Fig. 7). 
In particular, if if is a straight line, then K + M' is a straight 
line parallel to H\ If at the same time the line M' passes through 
the origin, then K + if is a straight line parallel to if and passing 
through the point K (Fig. 8). 
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2. JC and if are segments (in the plane or in space) not 
parallel to each other (Fig. 9). Then the set Jf + ££ is a paral- 
lelogram with sides equal and parallel to JT and if (respectively). 
What will result if the segments JT and if are parallel ? 

3. .W is a plane and if is a segment not parallel to it. The 
set JC + if is a part of space lying between two planes parallel 
to JIT (Fig. 10). 





Fig. 10 



4. Jf and if are circles of radii r, and r 2 with centres Pj 
and P 2 (respectively) lying in the same plane n. Then .^T + if is 
a circle of radius r, + r 2 with the centre at the point P t + P 2 
lying in a plane parallel to k (Fig. 11). 

2°. The visualization of equations and inequalities of the first 
degree in two or three unknowns. Consider a first-degree equation 
in two unknowns x and y: 

ax + by + c = (1) 

Interpreting x and y as coordinates of a point in the plane, it is 
natural to ask the question: What set is formed in the plane by 
the points whose coordinates satisfy equation (1), or in short what 
set of points is given by equation (1)? 

We shall give the answer though the reader may already know 
it: the set of points given by equation (1) is a straight line in the 
plane. Indeed, if 6/0, then equation (1) is reduced to the form 

y = kx + p 

and this equation is known to give a straight line. If, however, 
b = 0, then the equation is reduced to the form 

x = h 
and gives a straight line parallel to the axis of ordinates. 
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A similar question arises concerning the inequality 

ax + by + c > (2) 

What set of points in the plane is given by inequality (2)? 

Here again the answer is very simple. If b # 0, then the inequali- 
ty is reduced to one of the following forms 

y^kx^-p or y^kx + p 
It is easy to see that the first of these inequalities is satisfied by 




Fig. 11 

all points lying "above" or on the straight line y = kx + p and the 
second by all points lying "below" or on the line (Fig. 12). If, 
however, b = 0, then the inequality is reduced to one of the 
following forms 

x^h or x < h 

the first of them being satisfied by all points lying to the "right" 
of or on the straight line x = h and the second by all points to* 
the "left" of or on the line (Fig. 13). 

Thus equation (1) gives a straight line in the coordinate plane 
and inequality (2) gives one of the two half-planes into which 
this line divides the whole plane (the line itself is considered to 
belong to either of these two half-planes). 

We now want to solve similar questions with regard to the 
equation 

ax + by + cz + d = (3) 
and the inequality 

ax + by + cz + d 5= (4) 

of course, here x, y, z are interpreted as coordinates of a point 
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in space. It is not difficult to foresee that the following result will 
be obtained. 

Theorem. Equation (3) gives a plane in space and inequality (4) 
gives one of the two half-spaces into which this plane divides the 
whole space (the plane itself is considered to belong to one of 
these two half-spaces). 

Proof. Of the three numbers a, b, c at least one is different 




Fig. 12 

from zero; let c ^ 0, for example. Then equation (3) is reduced 
to the form 

z = kx + ly + p (5) 

Denote by if the set of all points M (x, y, z) which satisfy (5). 
Our aim is to show that if is a plane. 

Find what points in if belong to the yOz coordinate plane. 
To do this, set x = in (5) to obtain 

z = ly + p (6) 

Thus the intersection of if with the yOz plane is the straight line u 
given in the plane by equation (6) (Fig. 14). 

Similarly, we shall find that the intersection of if with the xOz 
plane is the straight line v given in the plane by the equation 

z = kx+p (7) 

Both lines u and r pass through the point P(0, 0, p). 

Denote by n the plane containing the lines u and v. Show 
that 7t belongs to the set if. 

In order to do this it is sufficient to establish the following 
fact, viz. that a straight line passing through any point Aev and 
parallel to it belongs to if. 

First find a point B such that OB\\u. The equation z = ly + p 
gives the straight line u in the yOz plane; hence the equation z = ly 
gives a straight line parallel to u and passing through the origin 
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(it is shown as dotted line in Fig. 14). We can take as B the 
point with the coordinates y=l, z = l which lies on this line. 

An arbitrary point Aev has the coordinates x, 0, kx + p. The 
point B we have chosen has the coordinates 0, 1, /. The straight 
line passing through A and parallel to u consists of the points 

A + sB = (x, 0, kx + p) + s(0, 1, /) = 

= (x, s, kx + p + s/) 
where s is an arbitrary number (see proposition (3) of section 1°).' 



y 


% 







\\\ N 





Fig. 13 




Fig. 14 



It is easy to check that the coordinates of a point A + sB 
satisfy equation (5), i.e. that A+sBe£f. This proves that the 
plane n belongs wholly to the set £f. 

It remains to make the last step, to show that if coincides 
with Jt or, in other words, that the set ££ does not contain any 
points outside n. ' 

To do this, consider three points: a point M (x , y > z o) 
lying in the plane rc, a point Af ' (x , y , Zo + £ ) lying "above" 
the plane it (e > 0), and a point M" (x , y , Zo — e) 'y m g "below" ;t 
(Fig. 15). Since Men, we have z = kx + ly + p and hence 

z + e > kx + ly + p 

z - e < kx + ly + p 
This shows that the coordinates of the point M' satisfy the 
strict inequality 

z > kx + ly + p 

and the coordinates of the point M" satisfy the strict inequality 

z < kx + ly + p 
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Thereby M' and M" do not belong to if. This proves that if 
coincides with the plane n. In addition, it follows from our 
arguments that the set of all points satisfying the inequality 

ax + by + cz + d Js 

is one of the two half-planes (either the "upper" or the "lower" one) 
into which the plane n divides the whole space. 

h 





Fig. 15 



Fig. 16 



2. Visualization of Systems of Linear Inequalities 
in Two or Three Unknowns 

Let the following system of inequalities in two unknowns 
x and y be given 

a t x + b x y + c x ^ 

a 2 x + b 2 y + c 2 ^ 



(1) 



a m x + b m y + c m ^0 



In the xOy coordinate plane the first inequality determines 
a half-plane n 1( the second a half-plane n 2 , etc. If a pair of 
numbers x, y satisfies all the inequalities (1), then the correspond- 
ing point M(x, y) belongs to all half-planes n 1? n 2 ..., n„ 
simultaneously. In other words, the point M belongs to the 
intersection (common part) of the indicated half-planes. It is easy 
to see that the intersection of a finite number of half-planes 
B a~ polygonal region Jf. Figure 16 shows one of the possible 
regions $C. The area of the region is shaded along the boundary. 
The inward direction of the strokes serves to indicate on which 
side of the given straight line the corresponding half-plane lies; 
the same is also indicated by the arrows. 
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The region ,W is called the feasible region of the system (1). 
Note from the outset that a feasible region is not always bounded; 
as a result of intersection of several half-planes an unbounded 
region may arise, as that of Fig. 17, for example. Having in mind 
the fact that the boundary of a region 3f consists of line 
segments (or whole straight lines) we say that JC is a polygonal 
feasible region of the system (1) (we remark here that when 





Fig. 17 



Fig., 18 



a region JC is bounded it is simply called a polygon*). Of course 
a case is possible where there is not a single point simultaneously 
belonging to all half-planes under consideration, i.e. where the 
region :/C is "empty"; this means that the system (1) is incom- 
patible. One such case is presented in Fig. 18. t 

Every feasible region ,?T is convex. It will be recalled that 
according to the general definition a set of points (in the plane 
or in space) is said to be convex if together with any two 
points A and B it contains the whole segment AB. Figure 19 
illustrates the difference between a convex and a nonconvex set. 
The convexity of a feasible region .%' ensues from the very way 
in which it is formed; for it is formed by intersection of several 
half-planes, and each half-plane is a convex set. 

Lest there be any doubt, however, with regard to the convexity 
of Jf , we shall prove the following lemma. 



* Here to avoid any misunderstanding we must make a reserva- 
tion. The word "polygon" is understood in the school geometry course 
to designate a closed line consisting of line segments, whereas in the litera- 
ture on linear inequalities this term does not designate the line itself but 
all the points of a plane which are spanned by it (i. e. lie inside or on 
the line itself). It is in the sense accepted in the literature that the term 
"polygon" will be understood in what follows. 
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Lemma. The intersection of any number of convex sets is 
a convex set. 

Proof Let Jf, and Jf 2 be two convex sets and let CfC be 
their intersection. Consider any two points A and B belonging 
to JT (Fig. 20). Since Ae^~ u Be$C x and the set ^T t is convex, 
the segment AB belongs to jT t . Similarly, the segment AB 
belongs to 3#" 2 - Thus the segment AB simultaneously belongs to 
both sets «>f j and CtT 2 and hence to their intersection $C. 





Fig. 19 




Fig. 20 



This proves that Jf is a convex set. Similar arguments show 
that the intersection of any number (not necessarily two) of convex 
ijiets is a convex set. 

f, Thus the locus of the points whose coordinates satisfy all the 
inequalities (1), or equivalently the feasible region of the system (1), 
$S a convex polygonal region 3C . It is a result of intersection of 
all half-planes corresponding to the inequalities of the given system. 
j Let us turn to the case involving three unknowns. Now we 
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are given the system 

a x x + b l y + c x z + d, ^ 
a 2 x + b 2 y + c 2 z + d 2 ^ 



(2) 



a m x + b m y + c m z + d m ^0 



As we know from Section 1, each of the above inequalities 
gives a half-plane. The region determined by the given system 




Fig. 21 



Fig. 22 



Fig. 23 



will therefore be the intersection (common part) of in half-planes, 
and the intersection of a finite number of half-planes is a convex 
polyhedral region Jf . Figure 21 exemplifies such a region" for m = 4. 
In this example the region Jf is an ordinary tetrahedron (more 
strictly, JC consists of all points lying inside and on the boundary 
of the tetrahedron); and in general it is not difficult to see that 
any convex polyhedron can be obtained as a result of the 
intersection of a finite number of half-planes.* Of course, a case 
is also possible where the region ;%' is unbounded (where it 
extends into infinity); an example of such a region is represented 
in Fig. 22. Finally, it may happen that there are no points 
at all which satisfy all the inequalities under consideration (the 
system (2) is incompatible); then the region JC is empty. Such a 
case is represented in Fig. 23. 



* Here we must give an explanation of the kind given in the footnot. 
on page 18. The thing is that in the school geometry course "polyhedron'' 
refers to a surface composed of faces. We shall understand this term in a 
broader sense, i.e. as referring to the set of all points of space spanned by 
the surface rather than to the surface itself, the set of course including 
the surface itself but only as its part. 
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Particular attention should be given to the case where the 
system (2) contains among others the following two inequalities: 

ax + by + cz + d ^ 

— ax — by — cz — d ^ 

which can be replaced by the sole equation 

ax + by + cz + d = 

The latter gives a plane n in space. The remaining inequalities (2) 






/It 



-^^->- 



Fig. 24 

will separate in the plane 7t a convex polygonal region which 
will be the feasible region of the system (2). It is seen that 
a particular case of a convex polygonal region in space may be 
represented by a convex polygonal region in the plane. In Fig. 24 
the region JJT is a triangle formed by the intersection of five 
half-planes, two of them being bounded by the "horizontal" 
plane n and the remaining three forming a "vertical" trihedral 
prism. 

By analogy with the case involving two unknowns, we call 
the region Jr the feasible region of the system (2). We shall 
emphasize once again the fact that a region Jf being the 
intersection of a number of half-planes is necessarily convex. 

Thus the system (2) gives a convex polyhedral region CtC in space. 
This region results from intersection of all half-planes corresponding 
to the inequalities of the given system. 

If the region Ctf is bounded, it is simply called the feasible 
polyhedron of the system (1). 
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3. The Convex Hull 
of a System of Points 

Imagine a plane in the shape of an infinite sheet of plywood to 
have pegs driven into it at points A u A 2 , -, A p . Having made 
a rubber loop, stretch it well and let it span all the pegs (see the 
dotted line in Fig. 25). Then allow it to tighten, to the extent 
permitted by the pegs of course. The set of the points spanned by 
the loop after the tightening is represented in Fig. 25 by the shaded 





Fig. 25 



Fig. 26 



area. It appears to be a convex polygon. The latter is called the 
convex hull of the system of the points A lt A 2 , ..., A p . 

If the points A u A 2 , ..., A p are located in space rather than in the 
plane, then a similar experiment is rather hard to put into practice. 
Let us give rein to our imagination, however, and suppose that we 
have managed to confine the points A l , A 2 , ., A p in a bag made 
of tight rubber film. Left to its own devices, the bag will tighten 
until prevented from doing so by some of the points. Finally, a time 
will arrive when any further tightening is no longer possible (Fig. 26). 
It is fairly clear that by that time the bag will have taken shape 
of a convex polyhedron with vertices at some of the points A t ,A 2 , ..., A p . 
The region of space spanned by this polyhedron is again called the 
convex hull of the system of the points A u A 2 , ..., A p . 

Very visual as it is, the above definition of the convex hull is not 
quite faultless from 'the standpoint of "mathematical strictness". We 
now define that notion strictly. 

Let A u A 2 , ..., A p be an arbitrary set of points (in the plane 
or in space). Consider all sorts of points of the form 

s l A l +s 2 A 2 + ... + s p A p (1) 
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where s ly s 2 , ..., s p are any nonnegative numbers whose sum is one: 
s,, s 2 , ..., s p $= and s, + s 2 + ... + s p =l (2) 

Definition. 77ie sef of points of the form (1) w/'f/i condition (2) i.s 
cfl//erf f/ie convex hull of the system of the points A u A 2 , ..., A p 
and denoted by 

<,Ai, A 2 , ..., A p y 

, To make sure that this definition does not diverge from the former, 
first consider the cases p = 2 and p = 3. If p = 2, then we are given 
two points A\ and A 2 . The set </!,, /1 2 >, as indicated by proposition 
(1) of section 1, is a segment AiA 2 . 

If p — 3, then we are given three points /4 1( A 2 and /1 3 . We show 
that the set </!,, /f 2 , A 3 } consists of all the points lying inside and 
on the sides of the triangle A l A 2 A 3 . 

Moreover, we prove the following lemma. 

Lemma. The set </!,, ..., A p -i, A p } consists of all segments joining 
the point A p with the points of the set (Ay, ..., A p ~-^). 

Proof. For notational convenience, denote the set (A { , ..., A p -i} 
by *M P ~ X and the set </4j, .... A p .. u A p y by -M p . 

Consider any point AtJ4 p . It is of the form 

A = s 1 A l + ... + s p .. , A p - , + SpA p 

where 

s u ..., s p ^ 0, sj + ... + s p = 1 

If Sj, = 0, then Ae.//^,; thus the set // p _ , is a part of . // p . If s p = 1 , 
then A = A p ; thus the point A p belongs to ..M p . So .4t p contains M , 
and the point A p . We now show that any segment A'A p where 
A ' e . // p _ , belongs wholly to . </. 
If /I is a point of such a segment, then 

A = tA' + sA p (t, s Js 0, r + s = 1) 

On the other hand, by the definition of the point A' we have 

A = t x A x +... + t p - i A p - l 

(f„ ..., t p .. x >0, f, + ... + *„_, = 1) 

hence 

A = tt } A 1 + ... + tt p .. l Ap- 1 +sA p 

Setting tt t = Si, ..., rf p _, = s p - { , s = s p , we have (1), (2). This proves 
that Ae.// p . So any of the above segments belongs wholly to ,.//. 
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Now it remains for us to check that the set M does not contain 
anything but these segments, i. e. that any point of <M P belongs to 
one of the segments under consideration. 

Let Ae.J? p . Then we have (1), (2). It can be considered that s„ ^ 1, 
otherwise A = A p and there is nothing to be proved. But if s p # 1, 
then $! + ... + s i = 1 — s p > 0, therefore we can write down 

^ =( '' + - +, p-.> L + !,: +v / ' + " 



!e^j A 



Si +...+*,_, "" 



+ V 4 * 
P P 



The expression in square brackets determines some point A' 
belonging to Jt ' ,, for the coefficients of /I ,,..., A p _ , are nonnegative 
in this expression and their sum is one. So 

A = (si +... + s„- i)A' + s„A p 

Since the coefficients of A' and A p are also nonnegative and their 
sum is one, the point A lies on the segment A'A P . This completes 
the proof of the lemma. 

Now it is not difficult to see that the visual definition of the 
convex hull given at the beginning of this section and the strict 
definition which follows it are equivalent. Indeed, whichever of the 
two definitions of the convex hull may be assumed as the basis, 
in either case going over from the convex hull of the system A u ..., 
Ap-i to that of the system A l7 ..., A p - U A P follows one and the 
same rule, namely the point A p must be joined by segments to 
all the points of the convex hull for A u ..., -4 p -i (this rule is 
immediately apparent when the convex hull is visually defined and 
in the strict definition it makes the content of the lemma). If we 
now take into account the fact that according to both definitions 
we have for p = 2 one and the same set, the segment AiA 2 , the 
equivalence of both definitions becomes apparent. 

The term "convex hull" has not yet been quite justified by us, 
however, for we have not yet shown that the set (A u A 2 , ..., A p } 
is always convex. We shall do it now. 

Let A and B be two arbitrary points of this set: 

A = SiAi + s 2 A 2 4- ... + s p A p 

B = t l A l + t 2 A 2 + ... + tpA p 
where 

Su •«, s p , t u ..., t p ^ 

s x + ... + s p = t l +... + t p =l ■ (3) 

24- 



: ||?iny point C of the segment AB is of the form 

£ C = sA + tB 

where 

s, f > 0, s + t = 1 (4) 

which gives 

C = sfoA, + ... + s p A p ) + t{t x A x + ... + t p A p ) = 
= (ss x + if,)/!, + ... + (ss p + tt p )A p 

The numbers preceding A u ..., A„ as coefficients are nonnegative 
arid their sum amounts to one (which follows from (3), (4)). This 
means that the point C belongs to the set </4-,, A 2 , ..., A p ), i.e. 
this set is convex. 

At the same time it is easy to see that </4,, A 2 , ..., A) is the 
least of all convex sets that contain the starting points A x , A 2 , ..., A p , 
viz. that it is contained in any of these sets. This statement follows 
directly from the lemma proved above and from the definition of 
a convex set. 

This explains the name "convex hull" and at the same time 
provides yet another explanation of the fact why the set </!,, A 2 , -, 
A„y can be obtained using the method described at the beginning of 
the section. For the set spanned by a rubber loop (or film) after 
the latter has tightened to its limit around the system of the points 
Ai, A 2 , ..., A p is exactly the least convex set that contains the 
indicated points. 

4. A Convex Polyhedral Cone 

Let's begin with a definition. 
'- A convex polyhedral cone is the intersection of a finite number 
of half-spaces whose htnimiary surfaces pass through a common point; 
the latter being called the vertex of the cone. 

We shall first of all point out how the notion of a convex 
polyhedral cone is related to systems of linear inequalities. We shall 
confine ourselves to a particular case, namely a case where the 
vertex of a cone is the origin of coordinates. This means that all 
boundary planes pass through the origin, and the equation of a 
plane passing through the origin is of the form 

ax + by + cz = 

(the absolute term in the equation must be equal to zero, otherwise 
(G, 0, 0) will not satisfy the equation). Thus a convex po- 
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lyhedral cone with the vertex at the origin is the feasible region 
of a system of homogeneous inequalities: 

a x x + biy + c x z > 
a 2 x + b 2 y + c 2 z ^ 

a m x + b m y + c m z ^ 
The reverse is true of course; the feasible region of a homogeneous 




Fig. 27 

system of inequalities is always a convex polyhedral cone with the 
vertex at the origin. 

An example of a convex polyhedral cone may be provided by 
a convex region in space whose boundary is a polyhedral angle 
with the vertex S, a kind of infinite convex pyramid without a base 
and extending unboundedly from the vertex (Fig. 27 represents one 
of such pyramids which has four faces). Other, less interesting cases 
are possible; for example: 

1. A half-space (Fig. 28, a). In such a "cone" the role of the 
vertex may be played by any point Sen, where re is the boundary 
plane of a given half-space. 

2. The intersection of two half-spaces whose boundary planes 
intersect along a straight line / (Fig. 28, b). The role of the vertex 
may be played by any point S e /. 

3. A plane. It is clear that any plane tc in space can be 
considered as the intersection of two half-spaces lying on different 
sides of 7i (Fig. 28, c). In this case the role of the vertex may 
be played by any point Sen. 

4. A half-plane (Fig. 28, d). The vertex S is any point of the 
boundary line. 
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5. A straight line. Every line / in space can be obtained by 
intersection of three half-spaces whose boundary planes pass 
through / (Fig. 28, e). The vertex S is any point of the line /. 
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6. An angle (less than 180°) in an arbitrary plane k (Fig. 28, J). 
One can obtain an angle by intersecting the plane n with two 
half-spaces (precisely how?). 

7. A ray (Fig. 28, g). A ray can be considered as the intersection 
of a straight line and a half-space. The vertex S is the beginning 
Cjf the ray. 

8. A point. This "cone" can be obtained by taking the common 
part of a ray and the corresponding half-space (Fig. 28, h). 

Of course, the enumerated examples 1-8 diverge (to a greater 
or lesser extent) from the usage of the word "cone", but we are 
compelled to reconcile ourselves to this if we are to preserve the 
general definition of a convex polyhedral cone given at the begin- 
ning of this section. 

We now try to show in a few words that the sets pointed out 
above exhaust all polyhedral convex cones in space. 
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Let p denote the number of half-spaces whose intersection is the 
cone Jf" under consideration. If p — 1, then our statement is valid, 
for then M~ is a half-space. A simple argument which is left to the 
reader shows that, if our statement is valid for a cone which 
results from intersection of p half-spaces, it is also valid for a cone 
formed by intersection of p + 1 half-spaces. It follows according 
to the principle of complete mathematical induction that our state- 
ment is valid for any p. 

Convex polyhedral cones possess many interesting properties. It 
is beyond the scope of the present book to go into these 
subjects, so we shall confine ourselves to a few simplest propositions. 

We introduce one more definition or notation, if you please. 

Let Bj, B 2 , ..., B q be an arbitrary set of a finite number 
of points (in space). The symbol (B u B 2 , ..., B q ) will denote a set 
of points of the form 

r,B, + t 2 B 2 + ... + t q B q 

where f 1( t 2 , ..., f are arbitrary nonnegative numbers. 

What is the geometric meaning of the set (B t , B 2 , ..., B q )l 
It is clear from the definition that it is the sum of the sets 
(Bi), (B 2 ), ..., {B q ); we must first see, therefore, what is the 
geometric meaning of the set (B), i.e. of the set of points 
of the form tB, where t is any nonnegative number and B a fixed 
point. But the answer to the last question is obvious: if B 
is the origin, then the set (B) also coincides with the origin; 
otherwise (B) is a ray emerging from the origin and passing through 
the point B. Now we remark that the sum of any set and the origin 
is again the same set; hence it is clear that when studying the sets (B^ 
B 2 , ..., B q ) we shall lose nothing if we consider all the points 
B,, B 2 , ..., B to be different from the origin. Then the set (B,, B 2 , 
..., B q ) will be the sum of the rays (B^, (B 2 ), ..., (B^). 

The last remark makes the following lemma almost obvious. 

Lemma. The set (B 1; ..., B ,, B (/ ) is a union of segments 
joining each point of the set (B ( , ..., B ,) with each point of 
the ray (B q ). 

The strict proof of the lemma is carried out according to the 
same plan as the proof of the similar lemma of Section 3; 
the reader is advised to carry it out independently. 

It is easily deduced from the lemma that (B,, B 2 ) is an angle, 
a straight line or a ray (Fig. 29, a, b, c). It is then readily 
established that (B 1 , B 2 , B 3 ) is one of the following sets: an 
infinite trihedral pyramid, a plane, a half-plane, an angle, a stra- 
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ight line or a ray. Now it becomes clear that there must exist 
a close relation between the sets (B,), {B 2 ), ..., (B q ) and convex 
polyhedral cones. Such a relation does in fact exist. For greater 
intelligibility we shall formulate the corresponding propositions as 
two theorems. 

Theorem 1. The set (B,, B 2 , ..., B q ) either coincides with the whole 
of space or else is a convex polyhedral cone with vertex at 
the origin. 




B , 



4 




(b) 



Fig. 29 

That the set (B,, B 2 , ..., B q ) can indeed coincide with the whole 
of space is shown by the following example. Consider four points 
B,, B 2 , B 3 , B 4 lying in such a way that the rays (B x \ (B 2 ), (B 3 ), (B 4 ) 
form pairwise obtuse angles (Fig. 30). Each of the sets (B 1; B 2 , B 3 ), 
(B,, B 2 , B 4 ), (B,, B 3 , B 4 ), (B 2 , B 3 , B 4 ) is an infinite trihedral 
pyramid with vertex at the origin. The set (B,, B 2 , B 3 , B 4 ) apparently 
contains all of these pyramids; and the union of the pyramids 
coincides with the whole of space! 

Theorem 2. Any convex polyhedral cone with vertex at the origin 
is a set of the form (B,, B 2 , ..., B„). 

The proof of Theorem I will be carried out on general lines. 
We shall take advantage of the method of complete mathematical 
induction. The statement of the theorem for q = 1 is obvious. Now 
we suppose that the theorem is valid for sets of the form (B,, ..., B q ) 
and, guided by this fact, prove it to be valid for the sets 
(B„ ..., B q , B„ +1 ). 

According to the induction hypothesis, (B^ ..., B (/ ) is either 
the whole of space or a convex polyhedral cone in it. As to the 
first case there is as a matter of fact nothing to be proved in it, 
for then (B,, ..., B q , B <J+I ) is also the whole of space. Let the 
second case occur and (B^ ..., B l( ) be a convex polyhedral 
cone- X. According to the lemma, the set (B,, ..., B q , B i;+I ) 
is a union of segments joining each point of the set .ff with 
each point of the ray (B +) ); and, as shown earlier, any convex 
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polyhedral cone Jf is either an infinite convex pyramid or one of 
the sets 1 to 8. Having considered the above union of segments 
for each of these cases, it is not difficult to make sure (check 
it for yourself) that either it coincides with the whole of space 
or is again a convex polyhedral cone. Thus the theorem is true 
for sets of the kind (Bj) and for {B u ..., B q „ B ,) as well, as soon 
as we suppose it to be valid for (B 1 , ..., B q ). Hence it follows that 
the theorem is true for any q. 





Fig. 30 Fig. 31 

Proof of Theorem 2. Let M' be a convex polyhedral cone with 

vertex at the origin 0. As already stated, 3C is either an infinite 

convex pyramid or one of the sets 1 to 8. 

Let M~ be a pyramid. We choose a point on each of its edges 

to get a system of points B lt B 2 , ... B q . We state that the 

set (B u B 2 , ..., B q ) is exactly X~. 
To prove this, consider a plane n intersecting all the edges 

of the pyramid Jf". We get the points B[, B{, ..., B' q (Fig. 31). 

Apparently, 

A' = Mi, % = k 2 B 2l B' q = k q B q ^(1) 

where k lt k 2 , ..., k are nonnegative numbers. 

Now suppose B is a point of the pyramid different from the 
vertex 0. The ray OB intersects with the plane k at a point B'. 
It is obvious that B' belongs to the convex hull of the system 
B[, Bi\ ..., B' q and hence 

B' = s x Bl + s 2 Bi + ... + s q B q 
where s t , s 2 , ..., s q are nonnegative numbers whose sum is one. 
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Now taking into account (1) we have 

B' = s x k,B x + s 2 k 2 B 2 + ... + s q k q B q 

and if in addition it is remembered that B' = kB (k> 0), we 
find that 

B = t 1 B 1 + t 2 B 2 + ... + t q B q 

where 

r,= ^i (i=l,2,..,,) 

Thus we have shown that any point B of the pyramid N belongs 
to the set (B t , B 2 , ..., B q ). The converse (i.e. that any point of the 
set (2?i, B 2 , ..., B) belongs to Ctf) is obvious. So JT coincides 
with (B u B 2 , ..., i q ). 

The case where M' is one of the exceptional sets 1 to 8 can be 
proved without much trouble and is left to the reader. 



5. The Feasible Region of a System 
of Linear Inequalities in Two Unknowns 

Our task now is to give an effective description of all solutions 
of a system of linear inequalities. In the present section we shall 
deal with systems involving two unknowns x and y. In spite of 
the fact that the number of unknowns is not large (only two), 
we shall try to carry out the analysis of these systems from 
general positions, i.e. so that the results obtained may be easily 
extended to systems in a larger number of unknowns. 

The solution of any system of linear inequalities is in the long 
run reduced to the solution of a number of systems of linear equations. 
We shall regard the solution of a system of linear equations 
as something simple, as an elementary operation, and shall not be 
confused if, to realize the proposed method, we have to perform 
this operation many times. 

1°. The necessary lemmas. Given a system^of inequalities 

a \ x + b^y + c, ^ 
a 2 x +.b 2 y + c 2 ^ 

(1) 



a„,x + b„,y + c,„ ^ 
It is found advisable to consider side by side with it the 
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corresponding system of homogeneous inequalities 

a x x + b x y ^ 



a 2 x + b 2 y ^ 



> 



/ 



(2) 



as well as the corresponding system of homogeneous equations 

a x x + b x y = ] 
a 2 x + b 2 y = I ^ 

a, n x + b m y = J 

We denote the feasible region of the system (1) in the xOy 
coordinate plane by Jf , that of the system (2) by M~ and that of the 
system (3) by if. Obviously, £f<=3fr , where the symbol c stands for 
the words "is contained in"*. 

Lemma 1. The following inclusion holds 

i.e. the sum of any solution of a given system of inequalities . and any 
solution of the corresponding homogeneous system of inequalities is 
again a solution of the given system. 

Proof. Let A be an arbitrary point of 3C and let B be an 
arbitrary point of Jf . Then the following inequalities are valid 

a x x A + b x y A + c x ^0 a x x B + b x y B ^ 

a 2 x A + b 2 y A + c 2 ^ a 2 x B + b 2 y B ^ 

and 

a m x A + b m y A + c m > a m x B + b m y B ^ 

Adding each inequality written on the left to the corresponding 
inequality on the right we have 

a\{x A + x B ) + b x (y A + y B ) + c x ^ 

a 2 (x A + x B ) + b 2 (y A + y B ) + c 2 $s * 



a m (x A + x B ) + b m (y A + y B ) + c m ^ 



* One should not confuse the symbol c with the symbol 6 introduced 
earlier. The latter is used when speaking of the belonging of a point to a set. 
If, however, one wants to record the fact that one set is a part of another, 
the symbol c is used. 

32 



These inequalities imply that the pair of numbers x A + x fl , y A + y B , 
the coordinates of the point A + B, is a solution of the original 
system (1), i.e. that A + Be:X'. Thus the lemma is proved. 

Lemma 2. (1) If a ray with the beginning at the point A belongs 
wholly to the set % and P is an arbitrary point of the ray, 
then P- Ae,yt" . 

(2) // a straight line belongs wholly to .'/f and A, P are 
two arbitrary points of the line, then P — Ae£f. 
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Proof of (1). Denote the point P—A by B. The ray under 
consideration consists of points of the form 

A + sB (4) 

where s is an arbitrary nonnegative number (Fig. 32). Any of these 
points is, according to the premises, a solution of the system (1), i.e. 

a t (x A + sx B ) + b x (y A + sy„) + c r ^ 

a 2 (x A + sx B ) + b 2 (y A + sy B ) + c 2 5= v 



a m (x A + sx B ) + b m (y A + sy B ) + c„ ^ 

Consider, for example, the first of these inequalities. It can be 
written down in the following form 

(ajx.4 + b. l y A + cj) + s(ajx 8 + b x y B ) > 

Since this inequality holds for any s > 0, the coefficient of s must 
clearly be a nonnegative number: 



2-300 
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Similarly, consideration of the remaining inequalities (5) leads to 
a 2 x B + b 2 y B ^ 



whence we see that the point B belongs to the set .JT - 

The proof of {2) is carried out in a similar way. The straight line 
under consideration consists of points of the form (4) where s is 
an arbitrary number. Therefore inequalities (5) are valid for any 
value of s. Hence it follows that in each of these inequalities the 
total coefficient of .s must be equal to zero, i.e. 

a l x B + b l y B = 

fl2* B + b 2 y B = o 



a m x B + K,v B = 

Therefore BeSf. Thus the lemma is proved. 

It is easy to see that Lemmas 1 arid 2 are valid for systems 
involving any number of unknowns. 

2°. The case where the system of inequalities (1) is normal. Consider 
again the system of inequalities ( 1 ) and the corresponding system of 
homogeneous equations (3). The latter system has an obvious 
solution x = 0, y = which is called a zero solution. In order to 
investigate the system (1) it turns out to be important to know if 
the system (3) has any nonzero solutions either. In view of this 
we introduce the following 

Definition. A system of linear inequalities is said to be normal 
if the corresponding system of linear homogeneous equations has only 
a zero solution. 

In other words, a system of inequalities is normal if the set if, 
the feasible region of the corresponding homogeneous system of 
equations, defined above contains only a single point (the origin 
of coordinates). 

The concept of normal system is meaningful with any number of 
unknowns, of course. 

It is not difficult to show that a compatible system of inequali- 
ties is normal if and only if its feasible region JC contains no 
straight lines. 

Indeed, if the system is normal, i.e. the set ¥ contains only 
the origin of coordinates, then the region ,W does not contain any 
straight lines, which follows directly from the second statement 
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of Lemma 2. If the system is not normal, then the set Z£ 
contains at least one point B different from the origin of coordina- 
tes. Of course, all points of the form kB, where k is any number, 
jlso belong to £C*. But in this case, whatever the point PeJT 
(and such a point is sure to exist for the system is compatible 
and the region ->T is therefore not empty), the set of all points of the 
form P + kB (where k is any number) belongs, according to Lemma 
1 to 3tiT. We know that the set is a straight line. So when 
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a system is not normal, the region Jf contains a straight line. 
This completes the proof of the above proposition. 

In this section we shall study the feasible region of the system 
(1) under the supposition that the system is compatible (the re- 
gion Ctf is not empty) and normal. 

From the fact that the region JT does not contain any straight lines 
it first of all follows that it must necessarily have vertices. The 
term "vertex" is understood by us in the following sense (close 
to the intuitive understanding of the word "vertex"). 

The vertex of a region JC is a point of the region which is 
not an interior point for any segment which lies wholly in -XT. In 
other words, the vertex is a point Ae.XT which has the following 
property: any segment belonging to .if and passing through A must 
have its beginning or end at this point (Fig. 33, a and h, where 
the point A is one of the vertices; in Fig. 33, b the region 
3f is a segment). 

We now explain at greater length why the convex set JT we are 
interested in has vertices. If .if lies on a straight line, then it is 
either a separate point, a segment or a ray, and the existence 
of vertices is evident. If JT does not lie on a straight line, however, 



* If the numbers x, y, z, the coordinates of the point B, satisfy a 

homogeneous system of equations, then the numbers kx, ky, kz, the 
coordinates of the point kB, satisfy this system too. 
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consider the boundary of this set. It consists of segments and rays 
W does not contain any whole lines). The end of any of these 
segments and the beginning of any of the rays will evidently be the 
vertices of .W. 

One can find the vertices of the region '/{' without much trouble. 
Notice first of all that in the xOy coordinate plane the ith inequality 
of the system (1) corresponds to the half-plane whose boundary 
line /, is given by the equation 

cijX + biy + c t = (i = 1, 2, ..., m) 

Evidently, the point A of the region .ff is a vertex if and only 
if it belongs to two different boundary lines. 

Let us agree to call regular any subsystem of two equations of 
the system 

«,.v 4- b 1 y + e, = 

a 2 x + b 2 v + <•-> = x 

(6) 

",.,* + b„,y + c„, = 

provided it has a unique solution (x,v). 

From the above description of the vertex now results the following 
method of finding the vertices of the region ■'/('. 

In order to find all the vertices one should find the solutions 
of all regular subsystems of the system (6) and pick out those 
which satisfy the original system (1). 

Since the number of regular subsystems does not exceed C,f„ the 
number of combinations of m things 2 at a time, the number of 
the vertices of the region .%' cannot be greater than that either. 
So the number of the vertices is finite. 

Remark. It follows from the above that, if the region ,W of the 
solutions of a normal system has no vertex, it is empty — the / 
system has no solutions (it is incompatible). 

Example I. Find all the vertices of the region W given by the 
system of inequalities 

x + y+1^0 

x - 2>> - 2 2* 

2.y - y - 4 ^ 

On solving the subsystems 

x + y + 1 = 0) x + y + 1 = 0) x - 2y - 2 = 0} 

x-2y-2 = 0j 2x-y-4 = 0j 2x - y - 4 = Oj 
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(all of them prove regular) we find three points: 

(0, -1), (1, -2). (2, 0) 
of which only the second and the third satisfy all the inequalities 
given. So it is the points 

,4,(1, -2) and A 2 (2, 0) 

that are the vertices of the region Jf '. 
Let us return to the system (1). Let 

<V *i A P 

be all the vertices of the region Jf". The set </!,, A 2 ,.... A p }, the 
convex hull of the system of points A u A 2 ,..., A p , also belongs 
to ,'A (for .W is a convex region!). But in that case, according 
to Lemma 1, the set 

<A U A 2 , ..., A p ->+jtr 

belongs to .W too. We shall show that as a matter of fact this 
sum coincides with -XT, that we have the following 
Theorem. If the system of inequalities is normal, then 

jr = </J„ A 2 , ..., A r >+.*r (7) 

where A t , A 2 ,..., A are all the vertices of the region -W . 

Proof Let P be an arbitrary point of the region ,/T different 
from the vertices of the region. The line A X P intersects the convex 
region .'/T either along a segment A X A (Fig. 34) or along a ray 
with origin at A l (Fig. 35). In the second case P — A { e.#" 
(Lemma 2), hence Pe/l, + .W . In the first case we reason as 
follows, however. If the point A lies on the bounded edge A,A, of 
the region .'JC (as in Fig. 34), then P belongs to the convex hull 
of the points A v . A-, A.\ if, however, the point A lies on an 
unbounded edge with origin at vertex A j (Fig. 36), then, according 
to Lemma I. we have AeA^-^'o and thereby Pe</4,. /!,-> + 
M\. Thus in all cases the point P proves to belong to the 
set </(,, A 2 ,.... Ay+-%" . Thus the theorem is proved. 
Since we are already familiar with the method of finding vertices, the 
only thing we lack for a complete description of the region W is the 
ability to find the region JC . The latter is the feasible region of the 
homogeneous normal system (2) which wc now proceed to describe. 

3 " . Vie homogeneous normal system of inequalities (2). Each of the 
inequalities (2) determines a half-plane whose boundary line passes 
through the origin of coordinates. It is the common part of these 
half-planes that is % - 



Among the boundary lines there are in this case at least two 
different ones (for the system (2) is normal!). Hence Jf either 
coincides with the origin of coordinates (x = 0, y = 0), or is a ray 
with vertex at the origin of coordinates or an angle smaller 
than 180° with vertex at origin. If we know two points B, and 
B 2 lying on different sides of the angle (Fig. 37), then all the 
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Fig. 36 Fig. 37 

points of the .uigle may be written down in the form 
B = t 1 B l +t 2 B 2 



(8) 



where t, and i 2 are arbitrary nonnegative numbers; and to find 
the points B, and B 2 is not difficult at all, if it is remembered 
that each of them (i) belongs to Jf , i.e. satisfies the system (2), 
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and (ii) lies on the boundary of J^ , i.e. satisfies one of the equa- 
tions (3). If J^o is a ray, then instead of (8) we have 

B = tB x (9) 

where B x is any point of the ray (different from the origin) and f is 
an arbitrary nonnegative number. 



y 
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Example 2. Find the region -X" of the solutions of the system 

x + y^O* 

x - 2y ^ 

2.x- y^O^ 

as well as the region M' of the solutions of the system in Example 1. 
Solution. The system (10) is normal; for the unique solution of 
the corresponding homogeneous system of equations 

x + y = (n 

x-2y = 0\ (11) 

2.y- y = 0j 

is (0, 0). 

Choose a point satisfying the first equation of (11) (but different 
from (0. 0)), the point C(- 1, 1), for example. We make sure by a 
simple check that the point C does not satisfy all the inequalities 
(10), therefore, neither the point itself nor any point of the ray OC 
(different from the origin O) belongs to -Jf . On considering the 
point — C (i.e. the point (1, — 1)) we find that it belongs to 
JT . So Bj = (1, — 1). The second equation is satisfied by the point 
(2. 1); it is also a solution of the system (10), so that B 2 -(2, 1). 
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■ '/T consists of the points (Fig. 38) 



The region 

i,B, + i 2 B 2 = 1,(1. - I) + ( 2 (2, !) = «, +2r 2 , -I, +t 2 ) 

where /, and t 2 are arbitrary nonnegative numbers. 

Turning to the system of inequalities of Example 1 we notice 
that it is (10) that is the corresponding homogeneous system. From 





Fig. 39 Fig. 40 

the theorem proved above we have 

jf = </i„ A 2 y + ,jtr 

where /),(1, —2) and A 2 (2, 0) are the vertices of the region Jf. 
So ■%' consists of the points (Fig. 39) 

s(l, -2) + (1 - .s)(2, 0) + (f, + 2t 2 , - t x + t 2 ) = 

= (2 - s + f , + 2r 2 , - 2s - f, + f 2 ) 

where ,v is any number in the interval [0, 1] and f,, t 2 are any 
nonnegative numbers. 
Example 3. Find the feasible region of the system 

2x- y>0' 

-4.\- + 2y^0 
x + y^0 

Proceeding as in Example 2 we find only a single ray: 

B = t(\, 2) = (t, It) (t^0) 

(Fig. 40). 

Example 4. Find the feasible region of the system 

2x-y>0' 
x + y ^ 
-3x + j'>0. 
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In this case none of the equations 

2x - >■ = 

.v + y = 

-3x + y = 

has solutions (except (0, 0)) which would satisfy all the given in- 
equalities. The region .'A" consists of a single point (0, 0), the 
origin of coordinates. 




Fig. 41 

4°. The case where the system of inequalities (1) is not normal. 
This means that the feasible region i/ J of the homogeneous system 
of equations (3) contains something else besides the origin of coordi- 
nates. Therefore, all the equations (3) determine the same straight 
line in the plane, and that line is W . 

According to Lemma 1 the region .W contains together with each 
of its points P a straight line P + !/' (a line passing through P 
and parallel to ¥). Consider a straight line T not parallel 
to W. If we know which points of the line T belong to 
the region .ff — denote the set of these points by :/f , r — then we 
shall be able to find the region W itself, for then JT = -W 7 + If 
(Fig. 41). 

The equation of the straight line ¥ is a x x + h^ y =- 0. One of 
the coefficients a t or ft, of this equation is different from zero; 
let b { ^0, for example. One can then take as a straight line J T not 
parallel to '-I' the y-axis (its equation is .v = 0). In this case the set 
.W , r — now denote it by ■'//" y is the part of the y-axis contained 
by -W. To find this set, one should put x = in the system (1). 



Then we have the system of inequalities 

biy + Ci ^0 

b 2 y + c 2 >0 v 

(12) 

in one unknown y which is easy to solve *. Notice that the set JtT v may 
be either an empty set (then 3T is also empty) or a point, a segment or 
a ray (but it cannot be the whole of the y-axis, for otherwise Jf would 
be the whole of the plane, which is impossible). On finding this set we 
shall know the region Jf' itself, for 

,tf = tf t +<£> (13) 

(if i€ is not parallel to the y-axis). 

Example 5. Find the feasible region -5T of the system 

x + y- 1 ^0" 
-x- y + 2^0 

2x + 2y + 3 > . 

It is easily seen that the system is not normal and that if is the 
straight line 

x + y = 

(not parallel to the y-axis). Setting x = 0, we have the system 

y- 1 >0~ 
-y+2^0 
2y + 3> 0, 

from which it is seen that -if ',., the intersection of J<^ with the 
j'-axis, is a segment with the ends C^O, 1) and C 2 (0, 2). So Jf 
is a set of points of the form (Fig. 42) 

(0, y) + (x, - x) = (x, y - x) 

where x is arbitrary and y is any number in the interval from 
1 to 2. 



* Notice thai the system (12) (viewed as a system of inequalities 
in one unknown) is now normal. Indeed, if otherwise, the corresponding 
homogeneous system would have a nonzero solution >■*; but then the sys- 
tem (3) would have the solution (0, y*) not belonging to iC. 
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Ih conclusion we shall briefly discuss a theorem which follows from 
the results obtained above. In the two-dimensional case wc are consi- 
dering (i.e. where everything takes place in the plane) this theorem is 
not particularly striking and it would be right to regard it as a 
starting point of the extension to the "/i-dimensional" case to be 
studied in Section 7. 




Fig. 42 



Theorem. Any (nonempty) convex polygonal region -W in the plane 
can be represented as the sum 



<A U A 2 , ..., A P } + (B U B 2 , ..., B q 



(14) 



The augend of the sum is the convex hull of a system of points A u 
<4 2 , ..., A p , and the addend is a set of points of the form 
t l B l + t 2 B 2 + ... + t q B q , where f,. t 2 . ..., t q are arbitrary nonnegative 
numbers. 

The theorem can be proved in a few words. Consider a system 
of inequalities giving :/T. If the system is normal, then equation 
(7) holds; bearing in mind that in this equation .%" is one of the 
sets of the form (B u B 2 ), (B,) or (0) (the origin of coordinates), 
we find that in the case where the system is normal our statement 
is valid. If the system is not normal, then equation (13) holds from 
which it also follows that ,W is representable in the required form 
(why?). 

Notice that if all points A u A 2 ,..., A coincide with the origin O, 
then the set </!,, A 2 ,..., A p y also coincides with O; then only the 
addend is left of the sum (14). When the points B u B 2 ,..., B q 
coincide with O, the set (B u B 2 ,..., B q ) also coincides with and 
only the augend is left of the sum (14). 
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The converse theorem also holds, though with some reservation. 
Theorem. Any set of the form 

</!„ A 2 , ..., A„) + (B U B 2 , ..., B q ) 

in the plane is either the whole plane or some convex polygonal region 
in it. 
The proof is fairly obvious. The addend, i.e. the region .W = 

(B t , B 2 B (/ ). is either the whole plane, or a half-plane, or an angle 

(smaller than 180), or a ray, or a point (the origin of coordinates), 




Fig. 43 

whereas the summand .X\ =</!], A 2 A r ) represents a convex 

polygon. The set .W\ +Jf can be obtained by translating Jf" to 
the segments OK x (where K { is any point of -W ,) and taking the 
union of the sets obtained (Fig. 43). It is easily seen that this produces 
either the whole plane (this is the case if -W^, is the whole plane) 
or some convex polygonal region in it. 

6. The Feasible Region of a System 
in Three Unknowns 

After the detailed analysis given in the preceding section we are 
now in a position to minimize the required theory when considering 
systems in three unknowns. 

Along with the original system 

a x x + b l y + c l z + cl 1 ^ 0) 

" } (1) 

"m* + b m y + c m z + (L ^ 
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as in Section 5. we again consider two more systems: 

• \ (2) 

and 

ci l x + b : v + c x z = 01 

' } (3) 

«,„x + b,„y + c m = --= ) 

We shall again denote the feasible region of the system (1) by -W\ 
that of the system (2) by -#' and that of the system (3) by 
i£'. To use the previously introduced terminology. -W is some con- 
vex polyhedral region in space and ■'//" is a convex polyhedral cone. 
As already noted, Lemmas 1 and 2 of Section 5 remain valid here 
too. 

T. The case where the system of inequalities (1) is normal. Here 
the region .W does not contain any straight lines and hence has 
at least one vertex. Indeed, if ■//' lies in the plane (and, as noted in 
Section 2, such a case is possible), then ■'/(' is a convex polygonal 
region in the plane which contains no straight lines and, as explained 
in Subsection 2 r of Section 5, must, therefore, have vertices. If the 
region -W does not lie in the plane, however, consider its boundary. 
This consists of faces each of which, being a convex polygonal 
region containing no straight lines, must have vertices; and it is easily 
seen that a vertex of any face is simultaneously a vertex of the 
region W. 

Converging in the vertex A of the region Jf ' are at least three 
boundary planes for which the point A is the only common point. 
Indeed, if this were not the case, all (he boundary planes passing 
throught A would either coincide or have a common straight line. 
But in that case a sufficiently small segment passing through A and 
lying in the common boundary plane or on the common boundary 
line would belong to -W . which is contrary to the definition of a 
vertex. 

This compels us to make some obvious changes in the method of 
finding vertices described in Subsection 2 of Section 5. That is, 
now we should say that a regular subsystem is a subsystem of 
three equations of the system 

I (4) 

a m x + b„,y + c,„z + d m = ) 
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2x + y + z - 


-1^0 


x + 2y + z - 


- 1^0 


x + y + 2z - 


- 1 ^0 


x+ y + z - 


1 >0 



rather than two, provided the solution (x, v, z) of the subsystem is 
unique. When a regular system is understood like this, the method 
of finding vertices remains exactly the same as before, namely: 

To find all the vertices of the region ,%\ one should find the 
solutions of all the regular subsystems of the system (4) and pick 
out those which satisfy the original system (1). 

The theorem of Subsection 2° of Section 5 also remains valid; 
the changes to be made in the proof of the theorem are obvious. The 
remark that a normal system has no solutions if the region .JT 
has no vertices also remains valid. 

Example 1 . Find the vertices of the region Jf given by the system 
of inequalities 



(5) 



Here the corresponding homogeneous system of equations is 
of the form 

2x+ y + z = 

x + 2y+ z = 

x + y + 2z = 

x + y + z = 

Solving it we see that the unique solution is (0, 0, 0); so the 
system (5) is normal. 

To find the vertices we shall have to consider all the subsystems 
of three equations of the system (4): 

2x+ y+ z-l=0~) 2x+ y+ z-l=0" 

x + 2y+ z - 1 = I x + 2y+ z-l=0 

x+ y + 2z-l = 0j x+ y+ z-l=0 

2x+ y+ z - 1 = 1 x + 2y+ z-l = 
x+ y + 2z-l = 0V x+ y + 2z- 1=0 
x + y+ z - 1 = ) x+ y+ z-l=0 

On making the required calculations we find that all the subsys- 
tems are regular and that their solutions are the points 

(1/4,1/4,1/4), (0, 0, 1), (0, 1, 0), (1, 0, 0) 
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of which the first does not satisfy the system (5) and the remaining 
three do. Therefore, the vertices of the region M' are the following: 

/Ml, 0, 0), /t 2 (0, 1, 0), A 3 (0, 0, 1) 

2°. The normal homogeneous system of inequalities (2). Each of the 
inequalities (2) determines a half-space whose boundary plane passes 
through the origin of coordinates. 

Here a single point, the origin of coordinates, is the intersection 
of the boundary planes (the system (2) is normal !). In other words, 
the set 3C , the feasible region of the system (2), is a convex polyhed- 
ral cone with a single vertex. It follows from the enumeration of 
convex polyhedral cones given in Section 4 that in our case CtC 
is either an infinite convex pyramid, a flat angle, a ray or, finally, 
a single point (the origin of coordinates). Omitting the last case for 
the time being, we have in all the remaining ones 

where B t , B 2 , ..., B are some points chosen one at a time on 
each edge of the cone ;XT (see Theorem 2 of Section 4). One can 
find such points from the following considerations. Each of them 
(i) belongs to Jf , i. e. satisfies the system (2), and (ii) belongs to the 
line of intersection of two different faces, i. e. satisfies disproportion- 
ate* equations of the system (3). 

If it is found that the only point satisfying conditions (i) and 
(ii) is (0, 0, 0), then the region JT coincides with the origin of 
coordinates. 

Example 2. Find the region .XC of the solutions of the system 

2x+ y+ z > (f 
x + 2y+ z^0 

x+ y + 2z>0 ( (6) 

x + y+ z ^ 

and, further, the region 3tC of the solutions of the system in Exam- 
ple 1. 

Notice first of all that the system (6) is connected with the system of 
inequalities (5) of Example 1 ; namely (6) is a homogeneous system 
corresponding to (5). Hence the system (6) is normal. 



* We call the equations ax + by + cz = and a'x + b'y + c'z = "dispro- 
portionate" if at least one of the equalities a/a' = bjb' = c/c' fails to hold; 
in this case the corresponding planes intersect along a straight line. 
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Here the system of two disproportionate equations can be set up 
in six different ways: 

x + 2y + r = 0) 2.x + y + - = 0) 2.x + y + z = 0) 

x + y + 2z = 0j x+ y + 2z = 0J x + y + z = 0j 

2x + y+ z = 0") x + 2y + z = 0) x + y + 2z = j 

.x + 2y + z = OJ x + y + z = Oj .x + y + z = Oj 

For each of these six systems, choose two nonzero solutions: (x, y, z) 
and (— x, — y, — z). For example, one can take (3, — 1, — I ) and (— 3, 
1, 1) for the first system; inequalities (6) are satisfied only by the 
first of these solutions. Hence we have the point B^ = (3, — I, — 1). 
Proceeding in similar fashion with the remaining five systems we 
find the points B, = (- I, 3, - I) and B 3 = (- 1, - 1, 3). So the 
region JT consists of points of the form 

fiBi + t 2 B 2 + t 3 B 3 = 

= (3fi - t 2 - r 3 , - r, + 3r 2 - r 3 , - r, - r 2 + 3/ 3 ) 

where r lr r 2 , r 3 are arbitrary nonnegative numbers. 

We now turn fo the system of inequalities (5) of Example 1. 
As already noted, it is (6) that is the corresponding homogeneous 
system. Therefore, the region Jf is of the form 

<A U A 2 , A 3 >+.XT 
and consists of the points 
Mi + s 2 A 2 + s 3 A 3 + ttBt + t 2 B 2 + t 3 B 3 = 

= 5, (1, 0, 0) + .v 2 (0, 1, 0) + s 3 (0, 0, 1) + 
+ f, (3, - 1, - 1) + f 2 (- 1, 3, - 1) + r 3 (- 1, - 1, 3) = 
= (s, + 3f, -t 2 - f 3 , s 2 - r, + 3t 2 - t 3 , s 3 -ti-t 2 + 3/ 3 ) 

where the numbers f,, ,' 2 , ^ 2f? arbitrary nonnegative ones and 
Si, s 2 , s 3 are nonnegative and sum to unity. 

3°. The case where the system of inequalities (I) is not normal. This 
means that the feasible region ¥ of the homogeneous system of 
equations (3) contains points different from the origin of coordinates. 
Since if is the intersection of planes, two cases are possible: 

1. ¥ is a straight line. According to Lemma 1 the region W 
together with each of its points P contains a straight line P + ¥. 
Consider some plane T which is not parallel to if. If we know 
which points of the plane 3~ belong to the region Jf — denote 
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the set of these points by W ',---we shall be able to find the 
region .W itself, for then JT ='.3T.. r + #\ 

But, whatever the straight line ^ may be, one can always choose one 
of the coordinate planes, xOy, xOz or yOz, as the plane ,-y 
not parallel to it. Assume, for example, that !£ is not parallel to the 
yOz plane. Take this plane to be ■? . Then the set XT _ r — denote 
it now by JT,..— is the part of the vOr plane contained in ..#" 
(Fig. 44). To find this set, one should put x = in the system (1). 
We then have the system of inequalities* 




Fig. 44 
b t y + c x z + d^ ^ 0" 
Ky + c m z + d m ^ 



(7) 



which can be solved using the method of Section 5. 
On finding the set .Jf" we shall be able to write down 



(8) 



(if the straight line if is not parallel to the yOz plane), 
which is the complete description of the region cfC . 

Remark. If it is found that the set Jt" rz is empty, so is Jf". 
This means that the system (1) is incompatible. 

ElZ™."! e 3. Find the region 3C of the solutions of the system 



(9) 



-2x+ y+ z- 


1 ^ 


- 3x - y + 4z- 


1 ^0 


- x - 2v + 3z 


>o 



* It is easily seen that the system (7) is now normal (see a similar 
footnote on page 42). 

49 



Consider the corresponding homogeneous system of equations 
-2x + y + z = 0~) 
-3x- y + 4z = ol (10) 

- x-2j/ + 3z = oJ 

Solving it we find that the third equation is a consequence of the 
first two, so that the system is reduced to the first two equations. 
The set of its solutions if is the straight line along which the planes 

- 2x + y + z = 
and 

- 3x - y + 4z = 

intersect. 

Choose some point B on the straight line if different from the 
origin of coordinates. To do this, it is enough to find some 
three numbers x, y, z (not vanishing all together) which satisfy 
the first two equations of the system (10). Take 1, 1, 1, for 
example. So if is the straight line OB, where B = (1, 1, 1). 

It is easy to see that the straight line if is not parallel to, say, 
the yOz coordinate plane. Setting x = in the system (9), we have 
the system 



y + z - 


1 ^0 


- y + 4z- 


1 ^0 


-2y + 3z 


^0 



in two unknowns y and z, which is normal. One can find its 
feasible region ,X\. . using the method of Section 5. On making the 
required calculations we find that J#" ',., is a set consisting of a 
single point A(3/5, 2/5) (in the yOz plane). Hence the sought region 
M' consists of all the points of the form 

A + tB = (0, \, I) + r (1, 1, 1) = (f, I + t, J + t) 

"'hv:S r iS any nonnegative number (the region Jf is a straight 
line parallel to ¥). 

2. if is a plane. Then take as a secant set y some straight line 
not parallel to this plane; in particular, one can take one of the 
coordinate axes. Assume, for example, that the z-axis is not parallel 
to i£\ take it to be :T . To find the set ,W '., the part of the 
z-axis contained in ->T, one should put x = 0, y = in the system (1). 
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We then have the system of inequalities 

c^ + di ^0~) 
c,„z + d,„ ^ 



(11) 



which is solved without much difficulty*. On finding the set tf '., 
we shall be able to write down (Fig. 45) 

Jf = .yf._ + <£ (12) 

(if the plane & is not parallel to the z-axis), which is the complete 
description of «?T. 




Fig. 45 

Remark. If the set ,W 2 is found to be empty, so is JT. 
The system (1) is then incompatible. 
Example 4. Find the region JT of the solutions of the system 

x-y + z + 1^0) 



■x + y-z + 2^0 



(13) 



Here the corresponding homogeneous system of equations is 
of the form 



x - y + z=0 
-x + y- z = 



(14) 



The system (11) is normal. 
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The second equation is a consequence of the first; therefore, the 
feasible region of the system (14) is the plane ¥ given by the equation 

x-y+z=0 

It is easy to see that this plane intersects the z-axis in a single 
point and hence is not parallel to the z-axis. Find the set -W '.. 
Setting .x = 0, y = in the system ( 1 3), we have the system 

z+ 1 ^0 

-z+2^0 

from which it follows that 

-Kz'^2 (15) 

So Jf is the set '/f z + if consisting of the points of the form 
(0, 0, z) + (x, y, — x + y) = ( x, y, z — x + y) where x and y are 
arbitrary and z satisfies the inequality (15). 

We conclude this section by formulating two theorems which gener- 
alize the last two theorems of Section 5 to the three-dimensional 
case. The only change we should make for this purpose in the 
formulations of the above-mentioned theorems of Section 5 consists 
in substituting the word "space" for "plane". 

Theorem. Any (nonempty) convex polyhedral region in space can be 
represented as the sum 

<X„ A 2 , ..., A„> + (B u B 2 , ..., B„) 

Theorem. Any set of the form 

</!„ A 2 , ..., A P }+(B U B 2 , ..., B,) 

in space is either the whole of space or some convex polyhedral 
region in it. 

The proofs of both theorems follow almost word for word those 
of the corresponding theorems in the two-dimensional case. Their 
elaboration is left to the reader. 

7. Systems of Linear Inequalities 
in Any Number of Unknowns 

In the foregoing sections we concentrated upon systems of inequa- 
lities in two or three unknowns. This was dictated mainly by two 
circumstances. Firstly, these systems are simple to investigate and 
allow one to keep entirely within the framework of "school" 
mathematics. Secondly, (which is more important in the present 
case) solutions of such systems have visual geometrical meaning 
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(as points in the plane or in space). However, more common in 
applications (in linear programming problems, for example) are 
systems of inequalities involving n > 3 unknowns. To pass them 
by in silence would greatly water down the presentation of the 
question. Therefore, we shall try to at least outline the situation 
for any n > 3. 

To visualize linear systems of inequalities in /; unknowns we 
must turn to the so-called n-dimensional space. 

We shall begin with the definition of relevant concepts, con- 
fining ourselves only to the most essential. 

A point of n-dimensional space is defined by an ordered set of /; 
numbers 



called the coordinates of the point. Such a definition is motivated 
by the fact, fundamental to analytic geometry, that a point in 
the plane is described by a pair of numbers and that in space 
by a triple of numbers. In what follows instead of saying "the 

point M has the coordinates x,. v 2 v„" we shall write M = 

(x u x 2 , ..., .*„) or simply M(.\ l , v 2 v„). The point (0. 0, .... 0) is 

called the origin of coordinates or just the origin. 

We shall first of all point out what is meant by a "segment" 
in H-dimensional space. According to Section 1, in ordinary space 
a segment M, M 2 can be described as a set of all points of the form 

s l M l + s 2 M 2 

where s u s 2 are any two nonnegalive numbers whose sum is one. 
Going from three-dimensional space to n-dimensional space we adopt 
this description as the definition of a segment. More strictly, let 

M'(.\-,'. x 2 \ -, .v,',) and M"(.\-','. x' 2 \ ..., x"„) 

be two arbitrary points of ^-dimensional space. Then we say that 
a segment M' ' M" is a set of all points of the form 

s'M' + s"M" = 

= (s'x\ + s"x';, s'x 2 + s"x 2 , ..., s'x'„ + sTx"„) (1) 

where s. s" are any two nonnegative numbers with a sum of 
one. When V = I, s" = we have the point M', when 
s' = 0, s" = 1 we have the point M". These are the ends of 
the segment M'M". The remaining points (they are obtained when 
s' > 0, s" > 0) are called the interior points of the segment. 
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Of other concepts pertaining to n-dimensional space we shall need 
the concept of hyperplane. This is a generalization of the concept of 
plane in ordinary three-dimensional space. Here the prefix "hyper" 
has quite definite meaning. The fact is that in n-dimensional 
space various types of "planes" are possible, viz. one-dimensional 
"planes" (they are called "straight lines"), two-dimensional "planes", 
etc., and finally (n - l)-dimensional "planes"; it is the last that are 
called "hyperplanes". 

Definition. In n-dimensional space, a set of points M (v,, x 2 ,-, x lt ) 
whose coordinates satisfy the equation of the first degree 

a l x l + a 2 x 2 + ... + a„x„ + b = (2) 

where at least one of the numbers a,, a 2 ,..., a n (coefficients of the 
unknowns) is different from zero, is called a hyperplane. For n = 3 the 
equation (2) assumes the form a^! + a 2 x 2 + a 3 x 3 + h = 0, which 
is none other than the equation of a plane in ordinary space 
(where the coordinates are denoted by x u x 2 , x 3 instead of x, y, z 
as usual). 

With respect to the hyperplane (2) the whole of n-dimensional 
space is divided into two parts: the region where the inequality 

a i x 1 + a 2 x 2 + ... + a„x n + b^O (3) 

holds and the region where we have 

fljXj + a 2 x 2 + ... + a ir x„ + b < (4) 

These regions are called half-spaces. Thus every hyperplane divides 
the whole of space into two half-spaces for which it is a common 
part. 

The concept of a convex solid is also generalized to the ;i-dimen- 
sional case. A set of points in n-dimensional space is said to be 
convex if together with any two of its points M' and M" it contains 
the entire segment M'M" as well. 

It is easily shown that any half-space is a convex set. Indeed, 
let the points M' (x[, x 2 ,..., x' n ) and M"(x'{, x' 2 \..., x") belong to the 
half-space (3). We prove that any point M of the segment M'M" 
also belongs to that half-space. 

The coordinates of a point M are written in the form (1) or, equiva- 
lent^, as 

x, = sx[ + (1 — s)x'( 

x„ = sx'„ + (1 -s)x" n 
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Substituting into the left-hand side of (3) we have 
a^sxl + (1 - s)x'{) + a 2 {sx 2 ' + (1 - s)x 2 ) + - 
... + a,{sx'„ + (1 - s)x") + b = 
= i<a,^' + a 2 x 2 + ... + a,X) + 
+ (1 - sXfl!*'/ + a 2 X2 + ... + a,X) + sft + (1 - s)6 

(we have replaced the number b by the sum sb + (1 — s)Z>), 
which is equal to 

s[a,x,' + ... + aX + 6] + (1 - s)[a,x;' + ... + a„x"„ + b~\ 

Each of the two sums in square brackets is nonnegative since 
both points M' and M" belong to the half-space (3). Therefore 
the entire expression is also nonnegative (for s > and (1 — s) ^ 0). 
This proves that the point M belongs to the half-space (3), 
i.e. that this half-space is convex. 

From the above it is easy to understand what geometric 
terminology should correspond to a system of linear inequalities 
in n unknowns. Given the system 

a x x x + a 2 x 2 + ... + a (r x„ + a ^ 

b r x\ + b 2 x 2 + ... + b„x n + b^0 

C { Xi + C 2 X 2 + ... + c„x„ + c > 

each of the inequalities determines a certain half-space while all the 
inequalities together determine a certain region JT in n-dimensional 
space which is the intersection of a finite number of half-spaces. 
The region JT is convex, since so is any of the half-spaces that 
form it. 

In n-dimensional space, by analogy with the three-dimensional case, 
a region which is the intersection of a finite number of half-spaces 
is called a convex polyhedral region or, if the intersection is a bounded 
set, simply a convex polyhedron. Here the words "bounded set" should 
be understood in the sense that the coordinates of all the points 
of a region under consideration do not exceed in absolute value 
a certain constant c: 
\xi\ < c,..., |x,J < c for all points of a given region. 

Thus, in n-dimensional space, a set of points whose coordinates satisfy 
the system (5) is the convex polyhedral region Jf resulting from intersec- 
tion of all half-spaces corresponding to the inequalities of the given 
system. 



Note again that if the region is bounded, it is called a convex 
polyhedron. 

The methods of actual description of the region W which have 
been considered for systems in two unknowns in Section 5 and for 
systems in three unknowns in Section 6 can, with appropriate changes, 
be extended to the case of n unknowns. We shall not go into 
this, however, for it would require rather much space. Besides, with 
a large number of unknowns these methods are not efficient, 
requiring as they do, too cumbersome calculations. 

It is remarkable that the general theorems on the structure of 
convex polyhedral sets in three-dimensional space remain fully valid 
in n-dimensional space, although requiring more elaborate proofs. 
We shall restrict ourselves only to the formulations of the theorems and 
to the essential explanations. 

Theorem 1. Vie convex hull of any finite system of the points A x , A 2 ,~, 
A is a convex polyhedron. 

For better intelligibility we shall emphasize that here a relation is 
established between two differently defined types of sets, viz. 
between the convex hull of a system of points /I,, A 2 ,..., A p which 
is designated as </!,, A 2 , ..., Ay and defined as a set of all 
points of the form 

M, +s 2 A 2 + ... + s p A r 

where .s^, s 2 ,..., s are any nonnegative numbers whose sum is one, 
and convex polyhedra, i.e. bounded regions resulting from inter- 
section of a finite number of half-spaces. 

In two- and three-dimensional spaces the validity of Theorem 
1 is obvious (at least from the visualization of the convex hull), 
while in the multidimensional case it is not obvious at all and re- 
quires to be proved. 

Theorem 1' (the converse of Theorem 1). Any convex polyhedron 
coincides with the convex hull of some finite system of points. 

In fact we can state even more: a convex polyhedron coincides 
with the convex hull of its vertices. The definition of a vertex is the 
same as in the two-dimensional case (a vertex is such a point of a 
polyhedron which is not an interior point for any of the segments 
belonging wholly to the polyhedron). It can be shown that the 
number of vertices is always finite. 

Theorem 2. Any set of the form (B u B 2 ,.... B (/ ) either coincides 
with the whole of space or is some convex polyhedral cone with 
vertex at origin. 

We remind that the symbol (B,, B 2 ,..., B) designates a set of all 



'/' 
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points which can be represented in the form 

r,B, + t 2 B 2 + ... + i q B q 

where t t , t 2 ,—, t are any nonncgative numbers. A convex polyhedral 
cone is defined as the intersection of a finite number of half-spaces 
whose boundary hyperplanes have a common point (the vertex of the 
cone). The validity of Theorem 2 in three-dimensional space was 
established in Section 4 (Theorem 1 of Section 4). 

Theorem 2'. Any convex polyhedral cone with vertex at origin can 
be represented as (B,, B 2 ...., B q ). 

The validity of the theorem for the three-dimensional case was 
proved in Section 4 (Theorem 2 of Section 4). 

Theorem 3. Any convex polyhedral region can be represented as 
the sum 

<X„ A 2 ,..., A lt y + (B { , B 2 ,..., B) 

Theorem 3'. Any sum of the indicated form is either the whole 
of space or some convex polyhedral region in it. 

8. The Solution of a System 

of Linear Inequalities 

by Successive Reduction 

of the Number of Unknowns 

From his elementary algebra course reader is familiar with the 
method for solving systems of linear equations by successive reduction 
pf the number of unknowns. For systems involving three unknowns 
\, y, z the essence of the method can be described as follows. 
\ From each equation of a given system, one finds the unknown z 
vi terms of the unknowns x and y. The obtained expressions 
^containing only x and y) are then equated to one another. This 
'eads to a new system, a system in two unknowns x and y. For 
example, the following was the original system 
2.x -3v + z= - 1 



x- y + 2z = 5 V (J) 

4y- -" = 5 1 
then, on solving each of the equations for r, wc have 

z = - 2.x + 3.v - 1 

z= -|.v+ y y + 5 2 } «t) 



4v - 5 
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after equating the expressions in the right-hand sides (it is enougr 
to equate the first of the expressions to each of the rest in turn 
we have the system 



-2x + 3y-l- 2 , , 2 . ^ ^ 

— 2x + 3y—\= Ay 

in two unknowns x and )•. The system (2) can be handled in the 
same way. From the system of equations (2) we find 

y = 5 X + 3( (2' 

y= -2x + 4J 
after which we get the equation 

3-x + ?-. = - 2x + 4 

involving now one unknown x. On solving the equation we fine 
x = 1 , after which from the system (2') we find y = 2, and final!) 
from the system (1') we have z = 3. 

It turns out that something of the kind can be done with an 
system of linear inequalities. Solving a system of inequalities in i 
unknowns x 1; ..., x„_,, x n is thus reduced to solving a system o 
inequalities in n — 1 unknowns x lv .., x n _ ,, then the resulting systen 
can be reduced to a system in n — 2 unknowns Xj,..., x„_, and r 
on and on till we come to a system in one unknown x,, ar 
solving a system in one unknown is quite an elementary task. In th 
way we get an opportunity of finding any solution (at least 
principle) of the original system of inequalities. 

So suppose a system of linear inequalities in n unknowns x u x± 
..., x n is given (for reference convenience it will be referred to a 
"the system (S)" in what follows). 

A number of questions arise in discussing the system (5 
Is it compatible? If it is, how are all of its solutions to be found 
When are systems of inequalities incompatible? Answers to all thes 
questions will be given in this and the next section. Here it is founc 
very helpful to connect to each system of inequalities a new systen 
in which the number of unknowns is less by one than in th 
original system; this new system is called concomitant. 

We proceed to describe it. 
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Consider any of the inequalities of the system (S). It is of the form 

01*1 + #2*2 + - + a„x n + a ^ (3) 

If a n = 0, leave the inequality unchanged. If a n < 0, transfer the 
term a„x„ to the right-hand side of the inequality and divide both 
sides by a positive number - «„ to get the inequality of the form 

b,Xi + ... + fr„-,Vi +b^x„ 

In the case of a n > 0, transfer all the summands but a„x„ to the 
right-hand side of the inequality and divide both sides by a„ to 
get the inequality 

x„^c l x i + ... + t'„-iVi +c 

" So on multiplying each of the inequalities of the original system 
by an appropriate positive number we get the equivalent system 
of the form 



P l 


>x„ 


Pl 


>X n 


p p 


^ x„ 




x„ 


>Qi 


x„ 


>Qi 


x„ 


>Q q 




R 


>o 


R, 


, ^0 


P 


^o 



(71 



v'here P lv .., P p , Q lt ..., Q r R lv .., R r are expressions of the form 



'i,x, + ... + a„-,x„ 



a (not containing .v,,)* 



*Of course, if the system (S) has no inequality in which a„ < 0. then the 
;ystem (T) will not have the first block. Similarly, if there are no inequali- 
ies with a„ > 0, then the system (7) will not have the second block. 
Mnally, if (S) has no inequalities with a„ = 0, then the third block will 
>e missing from (T). 
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In shorthand notation the system (T) can be written down as 

P* > x* > Q t 

Ry>0 

where a is any of the numbers 1, 2,..., p, p is any of the numbers 
1, 2,..., g, and y is any of the numbers 1. 2,..., r. 
Alone with the system (7) consider the system 

'£?} 

(where ct is any of the numbers 1, 2,..., p, p is any of the 
numbers 1, 2,..., q, and y is any of the numbers 1, 2,..., r) 
in 7i—1 unknowns .v !,..., .y„_ ,*. Let us agree to call this 
system concomitant (with respect to the original system (S) 
or to the equivalent system (71). 

There is a close connection between the solutions of the systems 
(S) and (S') which is expressed in the following 

Theorem. // the value of the last unknown x„ is discarded from 
any solution of the system (S), then we get a certain solution of the 
concomitant system (S 1 ). 

Conversely, for any solution of the concomitant system (S') it is 
possible to find such a value of the unknown .\ H on adjoining which 
we get a solution of the original system (S). 

The first statement of the theorem is obvious (if a set of values 
ofthe unknowns satisfies the system (S), then it does the system (7") too; 
but then all the inequalities of the system (S') hold for the same set too). 
We prove the second statement. 

Let 

be a solution of the system (S')- Substituting into the expressions 
Pi,..., P r , Qi,-, Q ir /?i,..., R,., we get some numbers P",..., 
P% (??,-, Qq, /??,..', R?- The following inequalities must hold 
for them 

P°> Q ° P (4) 

(a being any of the numbers 1, 2...., p, and p any of the 



* If the first or the second block is found to be missing from the system (T), 
then (.S") will consist only of the inequalities R. t > 0. If the third block is 
missing from (7), then (S) will have only inequalities l' y > Q„. 
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numbers I, 2,..., q) and 

R°,>0 (5) 

(y being any of the numbers 1, 2,..., r). 
The first group of the above inequalities (i.e. (4)) shows that each 

of the numbers Q? Q" is not greater than any of the numbers 

P?,..., P°. But in such a case there must be a number „\-° which 
lies between all the numbers Q",..., 0°, and all the numbers /"?, 

.... 1 n . 



P" 



n > 4 > qi 



where a is any of the numbers I, 2,..., /;, and (3 is any of the 
numbers I. 2,..., q (Fig. 46). These inequalities together with the 



ry-O 

-X- 



nO nO rjO . pO pO nO pO 

H ! H 3 "z 4 2 1 r 3 

Fig. 46 

inequalities (5) mean that the set of the values of the unknowns 
v - v° v - v° v - v° 

is a solution of the system {T) and hence of (S). Thus the theorem 
is proved. 

The following two additions to the theorem will play an important 
role below. 

1. A system (S) of linear inequalities is compatible if and only if so 
is the concomitant system (S'). This is a direct consequence of the 
theorem proved. 

2. All the solutions of the original system (S) can be obtained in 
the following way. One must adjoin to each solution v", ..., X?,.. { of 
the concomitant system (S') any of the numbers .v" lying between all 
the numbers Q", ..., Q'J and all the numbers P?, .... P". As a matter 
of fact this proposition was proved during the proof of the theorem. 

We shall say a few words about the geometric meaning of the 
theorem proved above. Suppose that (S) is a system of inequalities in 
three unknowns x, y. z. The concomitant system (S') is a system 
in two unknowns x, y. Denote by '/f (S) the feasible region of 
the system (S) (it is a certain set of points in space) and by W 
(S') the feasible region of the system (5') (a set of points in the plane) 
In geometric terms the theorem proved has the following meaning. 

Vie region ■//' (S') is the projection of the region -tf' (S) on the 
xOy coordinate plane. 
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So for an arbitrary system (S) of linear inequalities involving 
unknowns x t , v 2 , -, v„ we have constructed a new, concomitant system 
(S') involving the unknowns x t , x 2 , ..., x n _. ,, and for the system 
(S') one can in turn construct the concomitant system (S") (in- 
volving the unknowns x l5 x 2 , ..., x„_. 2 ), for the latter system one can 
construct the concomitant system (S'") and so on. 
Continuing the process we shall, after a number of steps, come 
to the system (S"'~") consisting of inequalities in one unknown x x . 
It follows from Proposition 1 stated above that the system (S) is 
compatible if and only if so is the system (S ( "~"), and answering 
the question concerning the compatibility or otherwise of a system 
in one unknown presents no difficulty. Thus it becomes possible 
for us to learn by quite simple calculations whether the system (S) is 
compatible or not. 

Suppose that the system is compatible. Then the problem arises 
of solving the system or, speaking at greater length, of indicating 
all of its solutions (all sets of values of the unknowns which satisfy 
the inequalities of the given system). We shall adopt the point of 
view (though it may at first appear to the reader strange) that the 
system (S) is solved if the systems (S'), (S"), ..., (S ( "~") are constructed. 
We shall presently see what explains such a point of view but first 
we shall introduce a 

Definition. A set of values of the first k unknowns 

v o v o v o 

A], A2, ..., x k 



is called feasible if it can be extended to the solution of the 
original system (S), i.e. if there exist numbers x° +i , ..., x° such that 
the set x°, ..., xjj 1 , x° +1 , ..., x° is the solution of the system (S). 

Once the systems (S'), (S") and so on are constructed, we are in 
a position: 

1) to find all feasible values of the unknown x, (from the system 
(i'"'-")); 

2) to find for any particular feasible value x\ all compatible 
values of the unknown x 2 , such that together with x? they form a 
feasible set (they are found by substituting x? into the system (S ( "~ 2) )); 

3) to find for any particular feasible set x?, x% all compatible 
values of the unknown x 3 (they are found by substituting x? 
and x% into the system (S 1 " -3 ')) and so on. 

It is in this sense that one should understand our statement 
that the system (S) is solved if the systems (5'), (S"), ..., (S (n ' l) ) 
are constructed. 
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Example. We solve in the above sense the system 

7x + 2y - 2z - 4 ^ 

-x- y- z + 4^0 

-2x + 3y + z- 1 5=0 

5x - y + z + 2 ^ 

On solving each of the inequalities for z we write down the 
system in the form 



- 2 x + y -2^ z 
-x - y +4>z 

z ^ 2x - 3>< + 1 
z > - 5x + y - 2 
The concomitant system is of the form 

,x + j'-2^ 2x-3j-+l 

lx + y-2^ -5x+ >'-2 

-x-y + 4^ 2x-3>-+l 

- x - y + 4 ^ - 5x + >' - 2 

- or, after the cancelling of the terms, 

^x + 4y-3^0 

>0 



^ 



(6) 



- 3x + 2y + 3 ^ 
4x - 2y + 6^0 

On solving each inequality for y we write down the system in 
the form 



y> - 

2x + 3 ^ y 
x^O 



5x + j 



jx-j 



(V) 
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The concomitant system is of the form 

2.x + 3 > - 3 
2.x + 3> \x 

it is equivalent to one inequality 

x>0 (8) 

. Thus the original system is compatible. According to the point of 
view we have adopted the systems (8), (7), (6) provide the solution 
of the set problem; namely, inequality (8) shows that there exists a 
solution (x, v, z) of the original system involving any nonnegative 
x. If a particular value of x is chosen, then from the system (7) 
one can find the feasible values for y. If particular values for 
x and v are chosen, then from the system (6) it is possible to 
find the feasible values of z. 

Set x = 1, for example; then from the system (7) we have the 
following inequalities limiting y: 

Take, for example, y = 4. Setting x = 1, y = 4 in the system (6), we 
have the following inequalities limiting z: 

.11 > - 

-\>z 
z ^ - 9 
z> -3 
or simply 

- 1 $s zSs - 3 

Setting, for example, z = — 2, we have one of the solutions of 
the original system: x = 1, y = 4, z = — 2. 

9. lncompiubiS Systems 

So far we have been dealing mainly with such systems of inequali- 
ties which have at least one solution (which are compatible). As 
far as incompatible systems are concerned, studying them may on 

64 



the face of it appear a needless pursuit: besides it seems implausible 
that one should be able to relate any interesting theory to such systems. 
In fact everything is quite different. The properties of incompatible 
systems are not only of interest in themselves, but also give key 
to the understanding of a variety of important facts. Thus the main 
linear programming theorem (the duality theorem, see Section 14) is 
in the long run derived from some properties of incompatible systems. 
Consider an arbitrary system of linear inequalities. For notational 
convenience consider for the lime being that the number of unknowns 
is three, although everything stated above equally applies to systems 
in any number of unknowns. 
So we are given the system 

a-,x + b 2 Y + c 2 z + cl-, ^0 

■ (1) 

a,„x + b„,y + c,„z + d„, ^ 0__ 
Multiply both sides of the inequality of (1) by a nonnegative 
number k x , both sides of the second inequality by a nonnegative 
number k 2 and so on, and then add the obtained inequalities 
together to come as a result to the inequality 

{k l a 1 + k 2 a 2 + ... + k,„a m )x + 

+ (k 1 b l + k 2 b 2 + ... + k m bjy + 

+ (A-,c, + k 2 c 2 + ... + k,„cjz + 

+ M, + k 2 d 2 + ... + k m d„, ^0 (2) 

which will be called a combination of the inequalities of (1). 

It may happen that a certain combination of the inequalities of 
(1) is an inequality of the form 

x x + x y + x z + d ^ (3) 

where d is a strictly negative number (division by \d\ then leads 
to the inequality - I $; 0). It is clear that no set of values of the 
unknowns satisfies such an inequality, therefore in the case under 
discussion the system (1) is incompatible (it has no solutions). It is 
quite remarkable that the converse proposition is also valid; namely, 
if the system (1) is incompatible, then a certain combination of its 
inequalities is of the form (3) where d < 0. 

We shall now prove this proposition in the general form (i.e. for 
systems in any number of unknowns), but first let us introduce the 
following definition. Let us agree to say that the inequality 

ax + by + cz + d ^ 
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is inconsistent if it is not satisfied by any set of values of the unknowns. 
Obviously, any inconsistent inequality is of the form (3) where d < 
(prove this!). The proposition to be proved can now be formulated 
as the following theorem. 

Theorem on incompatible systems of inequalities. // a system of 
linear inequalities is incompatible, then a certain combination of these 
inequalities is an inconsistent inequality. 

The proof is made by induction on n, the number of unknowns 
in our system. 
When n = 1 the system is of the form 



a x x + 1)^0 
a 2 x + b 2 5= 

a,„x + b m Ss . 



(4) 



One can suppose that all the coefficients a,, a 2 ,..., a m are nonzero. 
Indeed, if for example, a, = 0, then the first inequality is of the form 
x x + b, >0; if the number b l is nonnegative, then such an ine- 
quality may be discarded; if 6, is negative, however, then the first 
inequality of our system is inconsistent and there is nothing to prove. 
So let us suppose that none of the numbers a t , a 2 ,..., a m is zero. 
It is easy to see that these numbers are sure to contain both positive 
and negative numbers. Indeed, if all of the indicated numbers had the 
same sign, were they positive, for example, then the system (4) would 
be reduced to the form 



v> 



V > 



»1 



V ^ - 



; 

and would hence be compatible. 

Assume for definiteness that the first A: numbers of a,, a 2 ,-., a k are 
positive and the remaining m — k are negative. Then the system (4) 
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is equivalent to the system 



.\» 




.v» 





.v< 


_ ^ + 1 

"A + 1 




h„, 


\ ^ 


«». 



(5) 



y 



Choose the largest among the numbers — (r^/a,),..., — (b k /a k ); let 
it be — {bi/ai), for example. Then the first k inequalities of the system 
(5) can be replaced by a single (first) inequality. Similarly choose 
the smallest among the numbers - (b k + l /a k + ,),..., -(bjaj, the 
remaining m — k inequalities of the system (5) can then be replaced 
by a single (last) inequality. Thus the system (4) is equivalent to 
the system of two inequalities: 




and its incompatibility means that 

b, 



(6) 



From (6) we have 

^,,-V m <0 (7) 

(it should be remembered that u t > and a„, < 0). If the first inequal- 
ity of (4) is now multiplied by a positive number - u,„ and 
the last inequality by the positive number «,, then after addition 
we have the inequality 

Ox x + {b„,a ,-MJ ^0 (8) 
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which is by virtue of (7) inconsistent. For systems in one unknown 
the theorem is thus valid. We now assume that the statement of the 
theorem is valid for systems in n - 1 unknowns and under this 
assumption establish its validity for the case of n unknowns. 

So suppose an incompatible system of linear inequalities in n un- 
knowns *!, \- 2 , -, \'„ is given; keeping to the notation of the previous 
section we call it "system (S)". We construct the concomitant system 
(S') for it; the latter will be incompatible after (S). Since the number 
of unknowns in the system (S') is n — I, the hypothesis of induction 
applies to it. This means that a certain combination of inequalities 
of the system (S') is an inconsistent inequality. But it is easily seen that 
each inequality of the system (S') is a combination of inequalities 
of (S); indeed, if we simply add up the inequalities P^x n and 
x n > Q„ of the system (S), we gel P, + x n > x„ + Q|,or P^ ^ Q p , i.e. one 
of the inequalities of the system (S') (see Section 8, systems (T) and 
(S') ). Hence it follows in turn that a certain combination of inequali- 
ties of the original system (S) is an inconsistent inequality. Thus 
the theorem is proved. 

The theorem on incompatible systems of linear inequalities is 
just one of the manifestations of the deep analogy existing between 
the properties of systems of linear inequalities and those of systems 
of linear equations. Let us try to substitute the word "equation" 
for "inequality" in the formulation of the theorem. We shall have the 
following proposition: 

If a system of linear equations is incompatible, then a certain combi- 
nation of these equations is an inconsistent equation. 

It turns out that this proposition is also valid. It is called the 
Kronecker-Capelli theorem in a somewhat different formulation and 
is proved in linear algebra (this is the name of the part of mathema- 
tics which studies linear operations, i.e. such operations as addition of 
points or multiplication of a point by a number in n-dimensional 
space). For the above to be better understood, however, it is necessary 
to introduce clarity into the concept of combination. A combina- 
tion of equations is constructed in the same way as a combination 
of inequalities, the only difference being that one is allowed to 
multiply the given equations by any, not only nonnegative, numbers. 
As in the case of inequalities the word "inconsistent" refers to an 
equation having no solutions. It is easily shown that an inconsistent 
equation must certainly be of the form 

x x, + x x 2 + ... + x x„ + b = (9) 

where I? is a nonzero number (division of both sides by b gives 
the "equation" 1 = 0). 
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Especially important is one particular case of the theorem on in- 
compatible systems of inequalities, namely, the case where a given 
system contains the inequalities 

X|>0, x 2 >0, ..., x„>0 (10) 

Denoting the rest of the system by (S), one can say that the problem 
is to find all nonnegative solutions of the system (S) (i.e. the solu- 
tions satisfying conditions (10)). If the problem has no solutions, then 
according to the theorem just proved a certain combination of in- 
equalities of the system (S), 

« i x , + a 2 x 2 + ... + fl„.\-„ + a > (11) 

yields in conjunction with a certain combination of inequalities of 

(10), 

A-.-v, + k 2 x 2 + ... + k„x n > 
t (A-j, A' 2 ,..., A„ are nonnegative) 

the inconsistent inequality 

x x l + x x 2 + ... + x x„ + c ^ 

where c is a nonnegative number. Hence 

fll = - A, ^ 0, « 2 = - ><2 ^ 0, ..., a„ = - A'„ ^ 0, 

«<0 

We shall formulate the result obtained as a separate proposition. 

Corollary of the theorem on incompatible systems. If a system of 
inequalities has no nonnegative solutions, then a certain combination 
of these inequalities is an inequality of the form (11) where all the 
coefficients « t . a 2 a„ ^ and the absolute term a<0. 

10. A Homogeneous System 

of Linear Inequalities. 

The Fundamental Set of Solutions 

In Section 8 wc have discussed a method for finding solutions 
of systems of linear inequalities. In spite of its having many obvious 
merits the method fails to give answers to some questions; for 
example, it does not allow one to review the set of all solutions 
of a given system of inequalities. It is to this end that this and 
the next section of our book are devoted. The main difficulties, it 
will be seen, arise in considering homogeneous systems which arc dealt 
with in the present section: the general case (i.e. the case of a 
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nonhomogeneous system of inequalities) is examined in Section 11. 
There is no need here to confine ourselves to the case of two or 
three unknowns, from the outset we shall consider a system of any 
number of inequalities in any number of unknowns. For the reader's 
convenience our account is broken down into a number of points. 
1°. A linear function of n arguments. The general form of a ho- 
mogeneous inequality in n unknowns is 

fljx, + a 2 x 2 + ... + a„x n > 

Consider separately the expression in the left-hand side of the in- 
equality 

a x x x + a 2 x 2 + ... + a„x n (1) 

It is called a linear Junction. The role of the arguments is played by 
n variables x lt x 2 ,..., x„. One can assume, however, that function 
(1) depends on one rather than n arguments; this argument is 
the point 

X = (x,, x 2 ,..., x„) 

of ^-dimensional space. 

Let us agree from now on to designate function (1) as L(X) for 
short : 

L(X) = a,A', + a 2 x 2 + ... + a„x„ 

if we are given several functions like this instead of one, we shall 
designate them as mX), mX), etc. 

We establish the following two properties of a linear function. 

1. 

L(kX) = kL(X) 

where X is any point and k is any number. 

2. 

L(X + Y) = L(X) + L(Y) 

where X and Y are any two points. 

Property 1 follows in the obvious way from the equality 

a x (kx l ) + a 2 {kx 2 ) + ... + a„(kx„) = 

= k{a { x x + a 2 x 2 + ... + a„x„) 

We now prove property 2. Let 

-Y = (.y s , .v 2 ... a,,) and Y= (>',, y 2 , -, J"«) 
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Then 

L(X + Y) = fl,(x, + )-,) + a 2 (x 2 + y 2 ) + ... 

- + a„(x„ + v„) = (fliA'i + a 2 x 2 + ... + a„x„) + 

+ («i.v, + a 2 y 2 + ... + «„>>,) = L(X) + L{Y) 

2°. Some properties of the solutions of a homogeneous system 
of linear inequalities. Given a homogeneous system of m linear in- 
equalities in n unknowns 

ajX, + a 2 x 2 + ... + a n x n ^ (the first inequality) 
k\*\ + ^2*2 + ••• + b,r x n ^ ( tne second inequality) 

c l x l + c 2 x 2 + ... + c„x„ ^ (the nith inequality) 

Designate the left-hand sides of the inequalities as L X {X), L 2 (X),..., 
LJ.X) to rewrite the system as 

L 2 {X)^0 

(2) 

L(X)>0 
where 

X = {x u x 2 ,..., x„) 

We establish the following two propositions. 

1. // the point X is a solution of the system (2) and k is any 
nonnegative number, then the point kX is again a solution of the 
system (2). 

2. //' X and Y are two solutions of the system (2), then X + Y is 
again a solution of the system (2). 

Both propositions follow readily from the properties of a linear 
function proved in sect. 1 . Indeed, suppose / is any of the numbers 
1, 2,..., m. We have 

L,(kX)=--kL,(X)^0 

(for k ^ and L,(X) ^ 0) as well as 

L i {X+ Y) =/,(.¥) + L i (Y)>0 

(for L,(X)^0 and L,(y)>0). 

Propositions 1 and 2 immediately yield the following consequence. 
If certain points X t . A' 2 A'„ are solutions of the system (2), 



then so is any point of the form 

k l X l +k 2 X 2 + ... + k r X l , (3) 

where k u k 2 ,... y k p are nonnegative numbers. 

Indeed, by virtue of Proposition 1 each of the points k x X u 
k 2 X 2 ,..., k p X p is a solution of the system (2) but then by virtue 
of Proposition 2 so is the sum of the points. Let us agree to call any 
point of the form (3), where k u A 2 ,..., k are nonnegative numbers, a 
nonnegative combination of the points X,, X 2 ,-, X . Then the above 
consequence will allow the following statement. 

A nonnegative combination of any number of solutions of the homo- 
geneous system (2) is again a solution of this system. 

3°. The fundamental set of solutions. We introduce the following 
definition. 

A set of a finite number of solutions 

X i, X 2 ,..., X p 

of the homogeneous system (2) is said to be the fundamental set 
of solutions if any solution X of the system can be given by the 
formula 

X = fc^ + k 2 X 2 + ... + k„X p (4) 

where A,, A 2 ,..., A are nonnegative numbers. It follows that in this 
case formula (4) in which A,. A 2 ,..., k p are any nonnegative numbers 
gives a review of all solutions of the system (2). Hence it is clear 
that the problem of finding the fundamental set of solutions is 
one of primary importance in the investigation of the system (2). 
The development of an algorithm which would allow the fundamental 
set of solutions for any system (2) to be found using quite simple 
operations is what we set ourselves as the final object. 

4°. Construction of the fundamental set for a system consisting of 
one inequality. Construct the fundamental set of solutions for the 
inequality 



a,x, + a 2 x 2 + ... + a„x„ ^ (5) 

where the numbers a u a 2 ,.~, a n do not vanish together. 

To do this, consider along with inequality (5) the equation 

«i-v, + a 2 .\ 2 + ... + a„x„ = (6) 

The properties of a linear function proved in sect. I' readily yield 
the following two propositions: 

1. If X is some solution of equation (6) and A is any number, 
then kX is again a solution of equation (6). 



72 



2. If X and Y are two solutions of equation (6), then X + Y 
is again a solution of equation (6). 

The proof of the propositions is left to the reader. 

According to the premises there are some nonzero numbers among 
a u a 2 ,..., a„. Set a„^0, for example. 
Then the equation can be written down as 

•v„ = - — (fli-xi + a 2 x 2 + ... + o„_ ,.«,,_ ,) (6') 

Setting jc, = 1, x 2 = 0,..., .\„_ , = 0, we find from the last equation 
that x„ = — (a [/«„). Thus the point 

0, .... 0. - l ± 

is a solution of equation (6). Proceeding in a similar way one can 
obtain the solutions 

x, = (o, 1, .... 0, ~^- 



0,0 i, -"»- 1 



Now let 



X = (a,, a 2 , .... a„_,, a„) (7) 

be any solution of equation (6). According to (6') we have 

«,, = - "("IS, + «2*2 + - + «„.- I a n-1 > = 

Considering the point 

cCiX { + a 2 X 2 + ... + oc„.. , A"„.. i = 

= a A o, ... -::0+« 2 fo, i, ..., _.?)+... 



+ *.._, 0. 



0, ..., 1, -"""'I 



convinces us that its coordinates coincide with those of the point X. 
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Therefore the following equality is valid 

X = n l X l + u 2 X 2 + ... + <*„_,*„._! (8) 

We now add one more point 

X„=-(X l +X 2 + ... + X n .. l ) (9) 

to the points I,, X 2 . ..., A"„_, constructed earlier. It follows from 
the properties of the solutions of equation (6) referred to at the 
beginning of this subsection that the point X„ is also a solution. 
Now it is easy to prove the fact that any solution X of equation (6) 
is a nonnegative combination of the solutions X u X 2 , .... X ll _ i , X n . 
Indeed, let a be a positive number exceeding any of the 
numbers |ot l |, |a 2 | |ot„ _ , |. It follows from (8) and (9) that 

X = (oti +a.)X l +(a 2 + a)X 2 + ... 

... + («„_! + a)A r „_i +aX„ 

which proves our statement. 

For brevity of further writing denote the left-hand side of 
equation (6) by L(X). Choose some solution of the equation 
L(X) = 1 and denote it by X„ +1 . We state that the set of points 

X i, X 2 , ..., X„~i, X„, X n+l (10) 

is the fundamental set of solutions for inequality (5). 

Indeed, each of the points satisfies inequality (5). Now let A" 
be any solution of the inequality; hence L(A") = a where a ^ 0. 
Then the point 

X = X - aX n+l 

satisfies inequality (6) for 

L(X) = L(X') - aL{X n+1 ) = a-ax 1=0 

If we now write down 

X' = X + aX n+ 1 

and recall that the point X is a nonnegative combination of the 
points A - !,..., .¥„_,. X n it will be clear that X' can be represented 
as a nonnegative combination of the points (10). 

Consider a specific example. Suppose it is required to construct 
the fundamental set of solutions for the inequality 

- 2.x'! - 4x 2 + x 3 > (11) 
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in three unknowns x 1; x 2 , x 3 . 
First of all we write down the equation 

— 2xj — 4x 2 + x 3 — 

and solve it for one of the unknowns, x 3 , for example: 
x 3 = 2x l + 4x 2 

We now successively set one of the unknowns x l5 x 2 (contained 
in the right-hand side of the equation) equal to 1 and the remaining 
unknowns to zero, and get the solutions 

X, = (1, 0, 2), X 2 = (0, 1, 4) 

As X 3 we then take the point 

X 3 = -(X l +X 2 ) = {-\, -1, -6) 

and finally take as X A one of the solutions of the equation 

— 2xj — 4x 2 + x 3 = 1 

X* = (0, 0, 1), for example. 

The points X u X 2 , X 3 , X A form the fundamental set of solutions 
for inequality (11). The general solution is of the form 

X = kiXi + k 2 X 2 + k 3 X 3 + k A X A = 

= /c 1 (l,0,2) + A- 2 (0,l,4) + /c 3 (- 1,- 1, -6) + MO, 0,1) 

or 

x 2 = k 2 — k 2 

x 3 = 2k i + 4k 2 - 6/< 3 + kt. 

where k l , k 2 , k 3 , /c 4 are arbitrary nonnegative numbers. 

5°. Vie rearrangement of the structure of the fundamental set of 
solutions when another inequality is added to the system. In order to 
learn how to construct fundamental sets of solutions, first consider 
a problem like this. 

Suppose we are given the homogeneous system 

L 2 (X)>0l (12) 

LJX)>0) 
of linear inequalities. Suppose further that we know the fundamental 
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set of solutions 

A",, X 2 , ..., X p 

for that system. It is required to construct the fundamental set of 
solutions for the system resulting from the addition of another 
inequality 

L(X)^0 (13) 

to (12). 

The solutions of the system (12) arc precisely all nonnegative 
combinations of the points X ^ X 2 ,..., X . We must pick among 
these combinations those which would satisfy inequality (13) and, 
what is more, constitute the fundamental set of solutions for the 
system (12), (13). 

All points X l , X 2 , ..., X p can be divided into three groups 
with respect to the function L(X), the left-hand side of inequality (13): 
the points for which L{X) > 0, the points for which L(X) < 0, and 
finally the points for which L(X) = (). We designate the points of 
the first group as X\, X + 2 ,..., X\. the points of the second 
group as X' u X~ 2 ,..., A*",, and those of the third group as 

XI, xi Xl 

Thus 

X\. ..., Xf, Xi, ..., x,, xt ..., x? 

are the same points .V,, X 2 , .... X except that they are located 
perhaps in a different order. 

All the points A" v + (a= I k) satisfy inequality (13) of course. 

and so do X'Hy = I s). As to the points X |; (|5 = I /) none 

of them is a solution of inequality (13). However, of each pair 

X„ , Xp 

(one "plus" and one "minus" point) one can form a nonnegative 
combination 

aXt + bX ? (14) 

so that it should satisfy the condition 1{X) = 0. To do this one 
should take 

a= - L(X y> ). h= L(X., + ) (15) 

Indeed, the numbers a and h are positive and besides 

UaX; + hX { ;) = aL(Xf) +■ bL(X\l) = 

- -L(x,)L(x;) + L(x:;)L[x,) = Q 
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Denote the point (14), where a and b have the values indicated 
above, by X'^: 

x% = - L(* p - ) x: + ux:)xj ( 1 6) 

The answer to the set problem is given by the following 
Theorem. Tlie points 

Xt, ..., X k \ XI ..., X°, X° u , X° ]2 X", (17) 

(there are k + s + kl points here in all) form the fundamental set 
of solutions for the system (12), (13). 

To prove the theorem, we first establish the following lemma. 

Lemma. Any nonnequtive combination of the points X* and X~ 9 
can be represented as a nonneqative combination of the points X* , 
X",| or else as a nonnegative combination of the points A',',', X%. 

Proof of the lemma. Let 

X - cX* + (IX £ 

be a nonnegative combination of the points X+ and X' v . Along 
with X consider the point 

X% = aX: + bXt 

where the numbers a and b are given by formulas (15). Compare 
the two ratios, c/a and cl/b. If the first is greater than the second, 
then, setting d/b = X, c/a = k + u where (i > 0. we have 

X = (Xa + jifl) X a + + UXj = XX% + \iaX + 

i.e. the point X can be represented in the form of a nonnegative 
combination of X? and X^. If the above ratios are equal, 
then X = XX^p. Finally, if c/a < d/b, then, setting c/a = X, d/b = 
X + (x where u > 0, we have 

X = XX% + \ibXp 

Thus the lemma is proved. 

Proof of the theorem. Notice first of all that each of the points 
(17) satisfies the system (12), (13). To prove the theorem, all that 
remains therefore is to check the following: if some point X is 
a' solution of the system (12), (13), then it can be represented in 
the form of a nonnegative combination of the points (17). 

Being a solution of the system (12), the point X can be represented 
as a nonnegative combination of its fundamental points A",, X 2 ,..., X : 

X = aiXf + ... + a k X£ + b x X\ + ... 

... + b,xr +c t x ( ; + ... + c s x ( s (is) 
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where all the coefficients a ,,..., « A , />! ft,, f ,,..., r s are nonnegative. 

If all the numbers />,,..., b : are zero, then there is obviously 
nothing to prove. Suppose therefore that there are strictly positive 
numbers among those indicated above. Note that among a,,..., a k 
there are also strictly positive numbers, for otherwise we should have 

L(X) = />,L(A7) + ... + b,L(Xf) + c,L(X?) + ... 

- + cMx?) 

which is impossible since X satisfies inequality (13). 

Suppose for definiteness that <i, > and h t > 0. Making use of the 
lemma we can replace the sum a t Xf + biX 1 by a nonnegative 
combination of the points A"/". A' 1 ,', or of the points Aj~. X° u . Ff 
such a replacement is made in the expression for the point X, 
then the total number of nonzero coefficients of A"; 1 "...., X k + , A"f ,..., 
Xf will decrease at least by I. If at the same time it is 
found that not all of the coefficients of A" J",..., A - ," are zero in the 
newly obtained expression for A", then we again replace one of the 
sums of the form aX* + bXp by a nonnegative combination of 
the points A"*, A"°p or that of the points X$, A"? p ; as a result the 
number of nonzero coefficients of .X^,..., X k + , A"f ,..., Xj~ again 
decreases at least by 1. We continue in this way till an expression 
is obtained for the point A" in which all the coefficients of A"f ,..., 
A"/ are zero. We then come to the equality of the form 

X = a\Xt + ... + a' k X: + £4,„X°„ + 

+ c,X? + ... + fX 



where all the coefficients on the right are greater than or equal to 
zero. But this is exactly the required representation for X. Thus 
the theorem is proved. 

6°. The existence ami the method for the construction of the funda- 
mental set of solutions. Let us consider an arbitrary system of homo- 
geneous linear inequalities. For the first inequality of the system we 
can (using the method described in sect. 4 ) construct the fundamental 
set of solutions. On adjoining to the first the second inequality 
we can, on the basis of the theorem of sect. 5\ construct the 
fundamental set of solutions for the system consisting of the first 
two inequalities. We then adjoin the third inequality and so on until 
we have the fundamental set of solutions for the whole of the original 
system of inequalities. This proves the existence, and at the same time 
points out the method for the construction, of the fundamental set 
of solutions. 
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Of course, if in a given system of inequalities there is a subsystem 
for which one can at once point out the fundamental set of so- 
lutions, then that subsystem should be taken as the starting point; 
successively adjoining to it the remaining inequalities one will arrive 
after a number of steps at the desired fundamental set. 

Example. It is required to find for the system 

L, (X) = - 3x, - 4x 2 + 5.y 3 - 6x4 > 0] 
L 2 {X) = 2x x + 3x 2 - 3x 3 + x 4 ^ 

i.e. all solutions which satisfy the con- 



(19) 



all nonnegative solutions, 
ditions 




(20) 



To put it another way, it is required to find a general solution of 
the system (19), (20). 

It is easily seen that for the system (20) the fundamental set of 
solutions will be the set of the points 

A", =(1, 0, 0, 0), X 2 = {0, 1, 0, 0) 

AT 3 = (0, 0, 1, 0), X 4 = (0, 0, 0, 1) 

(indeed, any solution (a,, a 2 , <x 3 , a 4 ) of the system (20) can be repre- 
sented in the form a 1 X 1 + a 2 A" 2 + a 3 -Y 3 + a 4 X 4 ). Adjoin the first ine- 
quality of (19) to the system (20) and, using the theorem of sect. 5 C , 
construct the fundamental set of solutions for the system obtained in 
this way. For computational convenience make the following table: 













L,(X) 


*1 


1 











-3 


*2 





1 








-4 


*3 








1 





5 


x 4 











1 


-6 
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Indicated in each row of the table is one of the fundamental 
points of the system (20) and the value of the function L, (X) for 
that point. It is seen from the table that the only point of X^ type 
is X y that the points of A",,' type arc A",. X 2 . X+\ and that 
there are no points of .Y" type in this case. 

Find the points of A"" p type. They are 

X?, = 3*3 + 5*! = (5, 0, 3, 0) 
*32 = 4X 3 + 5X 2 = (0, 5, 4, 0) 
X$ 4 = 6X 3 + 5X 4 = (0, 0, 6, 5) 
To avoid making further writing more complicated, designate these 
points as V",, Y 2 , Y 4 (respectively) and write Y 3 instead of X 3 . 
■ The points Y 3 , Y^ Y 2 , Y 4 form the fundamental set of solutions 
for the system consisting of (20) and the first inequality of (19). 
Adjoin the second inequality of (19) to that system and make 
the followine table: 













UY) 


>;, 








1 





-3 


v> 


5 





3 





1 


Yi 





5 


4 





3 


v 4 








6 


5 


-13 



It is seen from the table that the role of the points Y\ is now 
played by >',. Y 2 and that of the points Y p ~ by V,. > 4 . and that 
there are no points of Y°, type. 
We find points of Y^ type: 

lft= 37,+ Y 3 = (15, 0.10. 0) = 5(3. 0. 2.0) 
Y 2 ° 3 = 3Y 2 + 3Y 3 = ( 0. 15, 15, 0) = 5( 0, 3. 3, 0) 

y,°4=i3r 1 + v 4 = (65, 0,45, 5) = 5(i3, 0, 9. u 

y? 4 = 13Y 2 + 3 Y 4 = ( 0, 65, 70, 15) = 5( 0, 13. 14, 3) 



The points V„ Y 2 , Y*/.,, Y° 23 , Y? 4 , Y? 4 form the fundamental set 
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of solutions for the system (19), (20). The general solution is of the form 

X = aY t + bY 2 + cY> 3 + dr 23 + eYl* +/V$ 4 = 

= a(5, 0, 3, 0) + 6(0, 5, 4, 0) + 5c (3, 0, 2, 0) + 

+ 5d(0, 3, 3, 0) + 5<?(13, 0, 9, 1) + 5/(0, 13, 14, 3) 

where a, b. c, d. e, f are any nonnegative numbers. 

Setting a = k u b = k 2 , 5c = /c 3 , 5d = k A , 5e = /< 5 , 5/ = k 6 , we have 
for X the representation 

X = M5, 0, 3, 0) + it 2 (0, 5, 4, 0) + Jt 3 (3, 0, 2, 0) + 

+ M0, 3, 3, 0) + /c 5 (13, 0, 9, 1) + fc 6 (0, 13, 14, 3) (21) 

where fc 1? & 2 ,..., ^6 are an y nonnegative numbers. 

To conclude this point, we note that having proved the existence 
of the fundamental set of solutions for any homogeneous system of 
linear inequalities we have thereby proved Theorem 2' of Section 7 
on the structure of any convex polyhedral cone. 

11. The Solution of a Nonhomogeneous 
System of Inequalities 

Now that we have learnt how to construct the general solution of 
a homogeneous system of inequalities it won't be difficult to solve 
a similar problem for an arbitrary, i.e. nonhomogeneous, system of 
inequalities. 

Let 

«i.x, + a 2 x 2 + ... + a„x„ ^ a 
Mi +b 2 x 2 + ... + b„x„^b v 

CjX, +c 2 x 2 + ... + c„x„^ c 

be an arbitrary system of linear inequalities in n unknowns 
Xj, x 2 ,..., .*„. Along with it consider the homogeneous system 

a l x l + a 2 x 2 + ... + a„x„ — at 5= 

Mi + b 2 x 2 + ... + b„x„ -bt^O v ( 



c \ x l + C 2 X 2 + - + c „ x „ — Cf 3* 

in n + 1 unknowns a- 1( .v 2 ,..., .*„. f. 
There is a relation of certain kind between solutions of the systems 



(1) and (2) in that if x,, x 2 ,—, x„, f is a solution of the system 
(2), with ( > 0, then the numbers 

.V 1= *», x 2 = ? 2 .?„ = *■!. (3) 

will constitute a solution of the system (1). 

Indeed, consider, for example, the first inequality of (2). It holds 
for the numbers v,, x 2 ,..., x„, /, i.e. 

a,*! + a 2 x 2 + ... + a„x„ ^ at 

On dividing both sides of the inequality by a positive t we have 

flj.Xj + a 2 x 2 + - + a,A',. > « 

but this means that the set of the numbers x t , x 2 ,.„, x„ satis- 
fies the first inequality of (1). A similar argument goes through 
for any inequality of (2), whence our statement. 

It is easily seen that any solution of the system (1) can be 
obtained by the above method. Indeed, if .v,, x 2 ,..., x„ is some 
solution of the system (1), then the numbers xj = x 1; x 2 = x 2 ,..., 
x„ = x„, f = I satisfy the system (2) and at the same time equalities (3) 
are valid. 

Thus, in order to find all the solutions x 1? x 2 ,-, x„ of the 
system (1) one should find all the solutions of the system (2) 
for which / > 0, and transform each of them according to formulas 
(3). 

Example. Suppose it is required to find all the solutions of the 
following system \ 

- 3x t - 4x 2 + 5x 3 > 6 * 

2x, -I- 3x 2 — 3x 3 ^ — 1 

x l > ) (4) 

x 2 ^0 

A 3 ^ 

Proceeding as pointed out above, write down the following 
auxiliary homogeneous system 

- 3x i - 4x 2 + 5x 3 - 6f ^ 
2.x ! + 3.x 2 - 3x 3 + f ^ 

A'l ^0 

x 2 ^0 

A 3 ^0 
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Adjoin to this system the inequality f > (for we are interested 
only in such solutions for which / > 0) to get the system (19), (20) 
of Section 10, the only difference being that we write f instead of 
x 4 . The solution set of this system is, as shown in Section 10 (see 
(21) of Section 10), given by the formulas 

.x, =5/c, +3A- 3 + 13fc 5 

x 2 = 5k 2 + 3l<4+ 13/c ( , 

a-., = 3/<, + 4k 2 + 2k i + 3/c 4 + 9/c 5 + 14/c 6 

t = k s + 3/c„ 

where k u k 2 ,-, k 6 are any nonnegative numbers. Since we are 
interested only in solutions for which t > 0, it should be assumed that 
at least one of the numbers k 5 , k 6 is nonzero (strictly positive). We now 
find the general solution of the system (4) from the formulas 

5/<, +3fc, + 13A, 
Xi — 



k 5 + 3/c 6 

_ 3fc, + 4k 2 + 2k 3 + 3/c 4 + 9k 5 + \4k b 
X3 ~ "k 5 -+3k 6 ""'" " 

It should be emphasized once again that in these formulas fcj, 
fc 2 ,..., k 6 are any nonnegative numbers, at least one of the numbers 
k s , k 6 being other than zero. 

Having established that solving the system (1) by the above 
method reduces to solving the homogeneous system (2) we have prov- 
ed Theorem 3 of Section 7 on the structure of any convex polyhedral 
region. This may be illustrated by the example of the system (4). Set 

k ^jrhk~ « = 1 - 2 ^ 4 > 

since the numbers k u k 2 . k 3 , /< 4 are arbitrary nonnegative, so are 
the numbers k{, k 2 \ k£, k%. Further set 

/. ■ _ k, _ , _3ki 

^ 5 ~ k 5 "+Jk 6 ' K6 k 5 + 3k b 

the numbers /c 5 ' and fc 6 ' are nonnegative and constrained by the 
condition /c 5 ' + kl = 1. Formulas (5) can now be written down in the 
form of a single equality 

(.v„ ,v 2 , .v 3 ) = fc,'(5, 0, 3) + kHO, 5, 4} + /< 3 '(3, 0, 2) + 

+ kHO. 3, 3) + fc 5 '(l3, 0, 9) + ki(0, y , ~) (6) 
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We introduce the notation: 

X x = (5. 0. 3), X 2 = (0, 5, 4). X) = (3. 0, 2) 

A 4 = (0. 3. 3). A" 5 = ( 13. 0. 9), X b = (0. y . y) 

Bearing in mind the above restrictions on k{, k{, fc 3 \ ki as well 
as on A 5 '. k^ equality (6) can now be interpreted as follows: 
the solution set of the system (4) is (X u X 2l X 3 , X A ) + <X 5 , X 6 >. 
Thereby the statement of Theorem 3 of Section 7 is proved for 
the system (4). 

12. A Linear Programming Problem 

Linear programming is a relatively new field of applied mathema- 
tics which developed in the 1940s or 1950s in connection with 
the tackling of varied economic problems. 

As a rule problems occurring in economics, and in production 
planning in particular, are problems of finding the most profitable 
variant. Each of them calls for an answer to the question as to how to 
use the limited available resources to obtain the utmost effect. Until 
recently the only method of solving such problems has been by ordi- 
nary rough calculation, estimating "by sight", or else by looking 
all the possible variants over to find the best. The situation is 
changing now. Over the past few decades the complexity of produc- 
tion has increased to such an extent that it has become impossible 
just to look the variants over. The factors influencing decisions have 
turned out to be so numerous that in some cases the number of 
variants is running into milliards. This has drastically increased the 
interest in mathematical methods in economics. Besides, the process 
of "mathematization of economics" has been promoted by the devel- 
opment of computing technique, in particular by the advent of 
electronic computers. 

Let us consider some examples of linear programming problems. 

Example 1. A factory turning out items of two types has an 
assembly shop with a production capacity of 100 items of the first 
type or 300 items of the second per diem; at the same lime the 
quality control department is capable of checking at most 150 items 
(of either type) per diem. It is further known that items of the first 
type cost twice as much as items of the second type. Under these condi- 
tions it is required to find such a production plan (so many items of 
the first type and so many items of the second per diem) which 
would ensure the largest profit for the factory. 
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The desired production plan is specified by means of two nonne- 
gative integers x, y (x being the number of items of the first type and 
y that of the second) which must satisfy the following conditions*: 

3.x + 3^ 300; x + .v^150 

2x + y is maximal 

In other words, from among the nonnegative integer solutions 
of the system 

3x + >- ^ 300 

x + v< 150 



(1) 



one should pick the one imparting the largest value to the linear 
function 

./ = 2.x + y 

Given an xOy rectangular coordinate system, the solution set of the 
system (1) will be represented by the shaded polygon of Fig. 47. 




Fig. 47 



* The first condition comes from the assembly shop. Indeed, it can turn 
out three items of the second type instead of one of the first. Hence, in 
terms of second-type items the shop's entire production is 3v + y articles; 
this number must not exceed 100. 
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From the same figure one can see that the point P (75, 75), one 
of the vertices of the polygon, is the solution of the problem. 

Indeed, consider a straight line 2x + y = c where c is a certain 
number. Denote the line by / c . As the number c increases, the line 
l c shifts "upwards" (at the same time remaining parallel to its initial 
position). The largest value of c at which the line / ( still has 
points in common with the shaded polygon is that value of c at which 
the line passes through the point P. Hence at this point the function 
2x + y attains its largest value (in comparison with its values at the 
rest of the points of the polygon). 

The example discussed is certainly very primitive, still it gives an idea 
of the nature of linear programming problems. In all of them it is 
required to find the maximal (or minimal) value of some linear function 
of n variables 

/= c l x l + c 2 x 2 + ... + c„x„ 

on condition that all these variables obey a given system of li- 
near inequalities (which must without fail contain the nonnegativity 
constraints on the variables: x, > 0,..., x„ > 0). In some problems (such 
as in the example above) an additional requirement is imposed on the 
variables, that they should be integers. 

Example 2 (diet problem). There are several kinds of food at one's 
disposal. It is necessary to compose a diet which would, on the one 
hand, satisfy the minimal human body requirements for nutrients 
(proteins, fats, carbohydrates, vitamins, etc.) and involve the smallest 
expenditures, on the other. 

Consider a simple mathematical model of this problem. 

Suppose there are two kinds of food, F; and F 2 , which contain 
the nutrients A, B, C. It is known how much nutrient of one or another 
kind is contained in 1 lb of fj or F 2 ; this information is presented 
in the following table. 





A 


B 


C 


F,, 1 lb 


«i 


/'. 


< ; i 


/• 2 - 1 'b 


«i 


h 2 


''2 



In addition to these data we know that a, b. c are daily requirements 
of human body fW 1. B. .' (resnc-:;! 1 >•''■■.. and tin:? s,, s 2 are costs 
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of 1 lb of F, and F 2 (respectively). It is necessary to compute the 
amount x t of the food Fi and the amount x 2 of the food F 2 so that 
the required amounts of the nutrients should be ensured with minimal 
expenditures on the food. 
Obviously the total cost of the food will be 

S = s i x l +s 2 x 2 

The total amount of the nutrient A in both kinds of food is 
a l x l + a 2 x 2 - It must not be less than a: 

a 1 x l + a 2 x 2 ^ a 

Similar inequalities must hold for B and C: b^i + b 2 x 2 ^ b, 
dXi + c 2 x 2 ^c. Thus we arrive at the following problem. 
We are given the system 

a 1 x l + a 2 x 2 ^ a~\ 

Mi + h 2 x 2 >b\ (2) 

c i x l + c 2 x 2 ^c\ 

of three linear inequalities in two unknowns x u x 2 and the linear 
function 

S = s 1 x 1 + s 2 x 2 

It is required to pick from among the nonnegative solutions (x l5 
x 2 ) of system (2) such a solution that the function S attains the 
smallest value (is minimized). Various problems can be reduced to 
such schemes, viz. alloy problems and problems in fuel-oil blending, 
feed mix problems and problems in fertilizer mixing, etc. 

Example 3 (transportation problem). Coal mined in several deposits 
is shipped to a number of consumers, to factories, power stations, 
etc. It is known how much coal is mined at each of the deposits, 
say, per month and how much is required by any of the consumers 
for the same term. One knows the distances between the deposits and 
the consumers as well as the traffic conditions between them; consi- 
dering these data one can calculate the cost of transporting each ton 
of coal from any deposit to any consumer. It is required that the 
transportation of coal should be planned in such a way under these 
conditions that the expenditures on it shall be minimal. 

Assume for simplicity that there are only two deposits £>,, D 2 and 
three consumers C,, C 2 , C 3 . The amounts of coal at D, and 
D 2 are a^ and a 2 respectively: let the requirements of C,, C 2 , C 3 
be bi, b 2 , b 3 respectively. Let us suppose that the total slocks of 
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coal are equal to the total requirements: 

ai +a 2 = b 1 +b 2 + b 3 

such an assumption is quite natural. Finally, the numbers c r (i = 1, 
2 ; ./ = 1 , 2, 3) are given, denoting the costs of transporting a ton of 
coal from D j to C.. The problem is to find the six numbers 

x lli x 12i x 13> ■ X 21> X 22< • 1c 23 

where x ( - is the amount of coal due to be shipped from D j to C-. 
For the convenience of reviewing we make the following table: 





To d 


To C 2 


To C 3 


Amount 
shipped 


From D, 


*n 


*12 


*13 


"i 


From D 2 


^21 


*22 


*23 


"2 


Amount 
delivered 


*l 


&2 


^3 





The total amount of coal shipped from D must be a x \ hence 
we have the condition 

A similar condition must hold for D 2 : 

X 21 + X 22 + *23 = a 2 

The total amount of coal delivered to C, must be b l ; hence 

*11 + *21 = &i 

Similarly we get the conditions 

x 12 +x 22 = b 2 , X 13 +X 23 =/> 3 

We assume that the cost of transportation is directly proportional 
to the amount of coal conveyed, i.e. transportation of coal from 
D, to C. costs CpXjj. The total cost of transportation will then be 

S — c n x u + c 12 x 12 + c 13 x 13 + c 21 x 21 + c 22 x 22 + c 23 x 23 



Thus we arrive at the following problem. 
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Given the system 

*11 + *12 + *13 = «i 
^21 + *22 + *23 = «2 

x,, +x 2l = b x 
X\2 +x 22 = b 2 

*13 +X 23 = /) 3 



(3) 



of five linear equations in six unknowns and the linear function 
S, it is required to pick from among the nonnegative solutions 

Xll, Xj 2 , - Y 13 , x 21> X 2 2, -*23 

of the system (3) such a solution that the function S attains its 
smallest value (is minimized). 

The problem can certainly be formulated in a more general 
form, i.e. with any number of deposits and consumers. It was given 
the name of "transportation problem" and was one of the first to be 
successfully solved using linear programming methods. 

We have considered in a simplified form three linear programming 
problems. Despite the diversity of their subjects the problems have 
much in common in their formulations. In each problem one seeks 
the values of several unknowns, it being required: 

(i) that these values should be nonnegative: 

(ii) that these values should satisfy a certain system of linear equa- 
tions or linear inequalities; 

(iii) that at these values a certain linear function should attain 
a minimum (or maximum). 

We remark that condition (ii) seems to be a disjoining rather than 
a uniting condition, for in one case the unknowns must satisfy equa- 
tions and in the other they must satisfy inequalities. But we shall see 
later that one case is easily reduced to the other. 

It is problems of this kind that linear programming is concerned 
with. More strictly, linear proa ramming is a branch of mathematics 
which studies methods of finding the minimal [or maximal) value of a 
linear function of several variables provided these satisfy a finite num- 
ber of linear equations and inequalities. The number of variables 
and that of conditions (equations or inequalities) may of course 
be arbitrary. In actual problems these numbers may be very large 
(some ten or several tens or even more). 

Let us put the above verbal statement down in strict terms of 
formulas. The general mathematical statement of a linear prog- 
ramming problem looks as follows. 



Given a system of linear equations 

a n x ] +a i2 x 2 + ... + a Ul x„ = b 1 
cijiXi + a 22 x 2 + ... + a 2 „x„ = b 2 

a m iXi + a m2 x 2 + ... + a m „x„ = b„ 



(1) 



and a linear function 

f=c i x l + c 2 x 2 + ... + c„x„ (II) 

Find a nonnegative solution 

A", ^0, .V 2 ^0, .... Y„^0 (III) 

of the system (I) such that the function f assumes the minimal value (is 
minimized). 

The equations of (I) are called the constraints of a given problem. 
Strictly speaking, conditions (III) are also constraints: it is not 
customary, however, to call them so since they are not characteris- 
tic of a given problem alone, but are common to all linear program- 
ming problems. 

Of the three examples considered above only the last (the 
transportation problem) corresponds, one would think, to the state- 
ment just given. The remaining two look slightly different since 
all the constraints they contain have the form of inequalities and 
not of equations. It is possible, however, using a simple method, 
to make inequality constraints go over into the equivalent constraints 
given in the form of equations. 

Assume, indeed, that the constraints of a given problem contain 
the inequality 

ct l x l + a 2 x 2 + ... + a„x„ + b^0 (4) 

We introduce a new, so-called additional, unknown v„+ , connect- 
ed with the unknowns .v,, y 2 , v„ by the equation 

<i,x, + a 2 x 2 + ... + a„x„ + b = x„ , , 

Inequality (4) is obviously equivalent to the nonnegativity condi- 
tion on .v„ + l . If an additional unknown is introduced for each 
of the inequalities contained in the system of constraints for a given 
problem, requiring in addition that all additional unknowns should 
be nonnegative, the problem will assume standard form (I), (II), 
(III) although involving a larger number of unknowns. We demon- 
strate this method using the diet problem as an example. The 
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system of constraints consists of three inequalities in this problem, 
so we introduce three additional unknowns x 3 , x 4 , x 5 . 
As a result the constraints assume the form of equations: 

aixi + CI2X2 — X3 = a~ 

biXi + bzXi — X4. = b 

c \ x l ~^~ c 2*2 — X 5 = 

It is required to find among all the nonnegative solutions of this 
system such a solution which minimizes the function 

S — SjX] + s 2 x 2 

Certainly, what we are essentially concerned with in the required 
solution are the values of x l and .v 2 . 

It is frequent for a linear programming problem to require that 
the maximum, and not the minimum, of a linear function / should 
be found out. Since max /= — min ( — f) (establish this for yourself), 
one problem is reduced to the other if / is replaced by — / 

We have shown that a linear programming problem having inequa- 
lity constraints can be reduced to a problem with equation constraints. 
It is highly interesting that the converse should also be possible, i.e. 
any linear programming problem can be stated in such a way that 
all constraints will assume the form of inequalities. We shall not 
dwell on this, however. -< 

In conclusion we shall make a few remarks concerning the adopted 
terminology. Any nonnegative solution of a system of constraints 
is called feasible. A feasible solution yielding the minimum of a 
function / is called optimal. It is the finding of an optimal solution 
that is our goal. The optimal solution, if any, is not necessarily unique: 
cases are possible where there may be an infinite number of optimal 

solutions. 

i' 

13. The Simplex Method 

Actual linear programming problems tend to contain a large 
nugiber of constraints and unknowns. It is natural that solving such 
problems involves a large number of calculations. This difficulty is 
overcome with the help of high-speed computers. The algorithm a 
computer programme is based on may be connected with a specific 
Class of problems. Thus, for example, there are very simple algorithms 
for solving the transportation problem which are conditioned by 
the peculiarities of its system of constraints. There exist, however. 
^general methods as well which allow a solution of a linear proiv 
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ramming problem to be found in a visible number of steps. The 
first and foremost of them is the so-called simplex method with some 
of its modifications*. 

1'. A description of the simplex method. So let us consider a 
linear programming problem. Given a certain system of linear equa- 
tions in n unknowns v,, .y 2 , v (l and a certain linear function / it 

is required to find among the nonnegative solutions of the given 
system such a solution which minimizes the function / 

To begin working by the simplex method it is necessary that the 
given system of equations should be reduced to a form such that 
some r unknowns are expressed in terms of the rest, the absolute 
terms in the expressions being nonnegative. Assume, for example, 
that /; = 5 and that the unknowns expressed in terms of the rest 
are .v,. \- 2 , x 3 . Hence the system of constraints is reduced to the 
form 

.X[ = a + OC4.Y4 + a 5 .v 5 ~\ 

X 2 = P + P4-V4 + Ps-vs I (1) 

•V'3 = Y + Y4-V4 + Y5-V5 j 

where 

a^O, p^O, y^O (2) 

Is it really possible to reduce the system to such a form and how 
is this to be done? This question will be considered later on (see 
sect. 2). The unknowns ,y,, y 2 , y 3 in the left members of the 
system (1) are called basic and the entire set {.v,, v 2 , .v 3 ) which 
for brevity we shall denote by a single letter B is called a 
basis: the remaining unknowns are called nonhasic or free**. Sub- 
stituting into the original expression for the function / the expres- 
sions in terms of the nonbasic unknowns of (1) for the basic un- 
knowns, we can write down the function / itself in the nonbasic , 
unknowns x A , .v 5 : 

/ = C + C4X4 + c 5 x 5 
We set the nonbasic unknowns equal to zero 

A - 4 = 0, .y 5 = 



* The name of the simplex method has nothing to do with the essence 
of the matter and is due to a casual circumstance. 

** The latter name is due to the fact that when finding the solutions of 
the system (I ((irrespective of a linear programming problem) these unknowns 
may be assigned any values. 
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and find from the system (1) the values of the basic unknowns: 

x, = a, .y 2 = p, x 3 = y 

The resulting solution of the system 

(a, (3. Y, 0, 0) 

will, due to (2), be feasible. It is called a basic solution corresponding 
to the basis B = j.v,, .\- 2 , x 3 }. For the basic solution the value of the 
function / is 

fti = c 

The solution of a linear programming problem by the simplex 
method falls into a number of steps. Each step consists in going over 
from a given basis B to another basis B' so that the value of /'should 
decrease or at least not increase: f lf ^f R . The new basis B' is derived 
from the old basis B in a very simple way: one of the unknowns is 
eliminated from B and another (a former nonbasic) unknown intro- 
duced instead. A change in the basis involves a corresponding 
change in the structure of the system (1), of course. After a certain 
number k of such steps we either come to a basis 6 (A| for 
which / M ,n is the desired minimum of the function / and the cor- 
responding basic solution is optimal, or else find out that the 
problem has no solution. 

We illustrate the simplex method by some examples. 

Example 1. Let a given system of constraints and a function / 
be reduced to the following form: 

x, = 1 - .v 4 + 2.v 5 j 
x 2 = 2 + 2.V4 - x 5 ,. 
x 3 = 3 - 3.V4 - x 5 

Here the unknowns x { , .v 2 , x 3 form the basis. The corresponding 
basic solution is 

(1, 2, 3, 0, 0) 

the value of / is for this solution. 

We find out whether the solution is optimal. Since x 5 has in / a 
negative coefficient, we may try to decrease the value of / by 
increasing x 5 (while retaining a zero value for .\' 4 ). Care should 
be taken in doing so, however, since changing \ 5 will lead to changes 
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in the values of x lt x 2 , x 3 and it is necessary to see to it that none 
of them become negative. 

There is no such danger for x,, since increasing x 5 results 
in the increase of x,. Examining x 2 and x 3 we find that x 5 can 
be increased to 2 (at most, otherwise x 2 will become negative) which 
yields x t = 5, x 2 = 0, x 3 = l. As a result we have a new feasible 
solution (5, 0, 1, 0, 2) in which the number of positive unknowns 
is equal to three as before. The value of / for this solution is 
equal to — 2. 

The new basis now consists of x l5 x 5 , x 3 . To make appropriate 
modifications in the system of constraints, it is necessary to express 
these unknowns in terms of x 2 , x 4 . We begin with the equation 
for x 2 (the new nonbasic unknown) solving it for x 5 (the new basic 
unknown): 

x 5 = 2 + 2x 4 - x 2 
we then express x u x 3 and /: 

x t = 1 — x 4 + 2(2 + 2x 4 — x 2 ) 

x 3 = 3 — 3x 4 — (2 + 2x 4 — x 2 ) 

/= x 4 - (2 + 2x 4 - x 2 ) 

Thus the problem is reduced to the form 

x, = 5 + 3x 4 — 2x 2 j 

x 5 = 2 + 2x 4 — x 2 s 

x 3 = 1 — 5x 4 + x 2 j 

./ = - 2 - x 4 + x 2 

The new basic solution is 

(5, 0, 1, 0, 2) 

the value of/ for this solution is equal to - 2. This completes the 
first step of the process. 

Let us see if it is possible to decrease the value of / still 
further. The coefficient of x 4 in the expression for / is negative, 
therefore it is possible to try to decrease /by increasing x 4 (without 
changing x 2 = 0). There is nothing in the first and the second 
equation to prevent it, and it is seen from the third that x 4 can 
be increased to 1/5 (at most, for otherwise x 3 will become negative). 
Setting x 4 = 1/5, x 2 = 0, we have x, = 28/5, x 5 = 12/5, x 3 = 0. As a 
result we arrive at a new feasible solution (28/5, 0, 0, 1/5, 12/5). 

The new basis now consists of x t , x 5 , x 4 . The equation for x 3 (the 
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new nonbasic unknown) is solved for x 4 (the new basic unknown): 



1 1 

V4_ 5 5' 



X d = T — ;X 3 + jX 2 



and the resulting expression is substituted into the other equations. 
As a result the system assumes the form 



*1 


= 


28 

5 


3 

■3*3- 


7 
3** 


*5 


= 


12 
. .. 


1 

-fvj- 


-!*. 


X 4 


= 


1 

5 


i*. + 


3-X2 



and the following expression is obtained for the function /: 

11,1 , 4 

5 + 5 X 3 + 5-- 



/ = - -v + ■=*, +-^2 



The new basic solution is 

(28/5, 0, 0, 1/5, 12/5) 

the corresponding value of /being equal to — 1 1/5. This completes 
the second step of the process. 

Since in the last expression for the function / both unknowns 
x 3 and x 2 have positive coefficients, the minimum of / is attained 
when x 3 = x 2 = 0. This means that the last basic solution (28/5, 0, 
0, 1/5, 12/5) is optimal and the required minimum / is equal to 
— 11/5; thus the problem is solved. 

In the example analysed the process has terminated in finding 
an optimal solution. Yet another termination of the process is possible. 
To illustrate it, we solve the following example. 

Example 2. 

x 3 = 1 + x, - x 2 
x 4 = 2 - x, + 2x 2 
/= - -v, - x 2 

Here the basis is formed by the unknowns x 3 , x 4 . The basic 
solution is of the form 

(0, 0, 1, 2) 

the corresponding value of the function / being equal to 0. 

In the expression for / the coefficient of X! is negative, therefore 
we try to increase x, (without changing .v 2 = 0). The first equation 
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does not prevent us from doing so. and it is seen from the second 
equation that Xi can be increased only to 2, which yields x 3 = 3, 
x 4 = 0. The new feasible solution is (2. 0, 3, 0): for this solution 
the value of / is equal to — 2. 

The new basis now consists of x 3 , a,. We solve the second 
equation for x, and substitute the resulting expression into the first 
equation and /. The problem assumes the following form 



.v., = 3 - x 4 + .\0 

xi= 2- x 4 + 2x 2 J 

/= -2 + .v, -3.v 2 

The new basic solution is 

(2, 0, 3, 0) 

the corresponding value of / being equal to — 2. 

In the last expression for / the coefficient of x 2 " s negative. We 
want to see how much we can decrease the value of/ by increasing 
x 2 (while keeping x 4 = 0). For this purpose we look over the x 2 terms 
in both equations of the system and notice that both coefficients 
of x 2 are positive. Thus x 2 can be increased without limit while 
keeping v., and v, positive, / taking arbitrarily large absolute nega- 
tive values. So min / = — co (it is said that the function / is not 
bounded from below) and there exists no optimal solution. 

As is seen from the above examples, each successive step in the 
simplex method is based on the choice of a negative coefficient for 
some nonbasic unknown x, in the expression for f. If it turns out 
that there are several negative coefficients, one may choose any of 
them. This introduces a certain amount of arbitrariness into the com- 
putations. The arbitrariness does not necessarily end here, however; 
it may happen that increasing x ( to the extreme makes several basic 
unknowns vanish together. Then it is possible to make any of them 
x, exchange roles with x ., i.e. to make .v, nonbasic and, on the contrary, 
introduce x ( into the basis. 

It would of course be possible to eliminate the arbitrariness by 
introducing some additional agreement. There is no particular need 
to do it, however. In fact some arbitrariness is even helpful, for it 
varies the computation process and hence allows one to seek such 
a sequence of steps which would lead as quickly as possible to the 
solution of the problem. 

2 r . Finding the first basis. In the previous subsection we described 
the procedure for solving a linear programming problem by the 
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simplex method. We required as a preliminary condition that the sys- 
tem of constraints should be reduced to the form * 



(3) 



x, =a + a r+1 x r+1 + ... + a„x„ ■ 

*2 = P + P\ + ,*, + ! + - + PA, , 

f 

where a > 0, P ^ 0, ..., y > 0; then we say that the unknowns .\- l7 
x 2 , ..., x r form the basis. 

In many linear programming problems the basis can be directly 
perceived, and in others it has to be found. We shall consider one 
of the methods of finding the basis generally known as "the method 
of an artificial basis". 

We shall analyse an example to illustrate the method. 

Example. Given the system of constraints 

2x, - 2x 2 + 2x 3 - .v 4 - 7x 5 = -4) 

-Xi + 3x 2 -2x 3 + x 4 + 3x 5 = 5J 

it is required to solve it for a certain original basis. 

Let us first of all transform the system so that the absolute 
terms of the equations should be nonnegative. To do this we should 
multiply both members of the first equation by - 1. We 
get the' following system 

-2xi + 2x 2 - 2x 3 + x 4 + 7x 5 = 4 j 

-x Y + 3x 2 - 2x 3 + x 4 + 3x 5 = 5 J 

We now introduce auxiliary, or artificial, unknowns y,, v 2 (one 
for each equality) in the following way: 

)>i = 4 — ( — 2x x + 2x 2 - 2x 3 + x 4 -t- 7x 5 ) 



(5) 
y 2 = 5 - ( - Xi + 3x 2 - 2x 3 + x 4 + 3x 5 )j 

Obviously all solutions of the original system (4) can be obtained 
by taking all the solutions of the system (5) which satisfy the 
conditions y, =0, y 2 = 0, and keeping only the values of x,,..., x 5 
m each of those solutions. 

The unknowns y,, y 2 form the basis in the system (5) Suppose 
that starting from this basis we succeed in going over to another 



* Or to a similar form where the left members contain some other r 
unknowns rather than x x , x 2 ,..., x r ; the remaining r\ — r unknowns must 
enter into the right members. 
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basis which contains no artificial unknowns. Then omitting the terms 
containing y, and y 2 from the resulting equations (or, equivalently, 
setting y, =0, y 2 = 0) we get a system equivalent to the original 
system (4), this system being solved for a certain basis. 

It remains to decide how to transform the unknowns y,, y 2 of 
the system (5) into nonbasic unknowns. It is remarkable that we 
should be able to use the simplex method for this purpose too; 
namely, using this method we shall work out the problem of mini- 
mizing the function 

F = yi + y 2 

under constraints (5) and the conditions x t > 0, ..., x 5 ^ 0, y { > 0, y 2 > 0. 
Here the premises under which the simplex method begins to work 
are satisfied since the system (5) is of the required form (it has 
the original basis y,, y 2 ). In some steps we arrive at the desired 
minimum. Since F > and hence min F ^ 0, two cases are possible: 

1 . min F > 0. This means that the system (5) has no nonnegative 
solutions for which y, = 0, y 2 = (otherwise min F = 0). Therefore 
the original system (4) will have no nonnegative solutions in this case. 
Hence it will follow that any linear programming problem with such 
a system of constraints is insoluble. 

2. min F = 0. Suppose that in this case (x°, ..., x°, y\, y 2 ) is an 
optimal solution. Since y° + y° 2 = min F = 0, we have y? = 0, y 2 - 0. 
It follows that (x? ,..., x°) will be a nonnegative solution of the original 
system (4). 

Thus in the case of min F = the system of constraints (4) will have 
at least one nonnegative solution. 

Further, if on accomplishing the process (i.e. when min F = has 
been attained) it is found that the artificial unknowns y lt y 2 are 
among the nonbasic ones, we have achieved our object — we have 
separated the basis from the unknowns x ,,..., x 5 . If, however, it becomes 
clear that some of the unknowns y u y 2 still belong to the basis, then 
some further transformations are required. 

So we solve the problem of minimizing the function 

F = y x + >> 2 = [4 - (-2xj + 2x 2 - 2x 3 + x 4 + 7x 5 )] + 

+ [5 - ( - x, + 3x 2 - 2x 3 + x 4 + 3x 5 )] = 

= 9 + 3x, - 5x 2 + 4x 3 - 2x 4 - 10x 5 

In the expression for F the coefficient of x 4 is negative, we there- 
fore try to decrease the value of F by increasing x 4 . Comparing the 
coefficients of x 4 and the absolute terms in the equations of (5) we 
find that x 4 can be increased only to 4, y t then vanishing. The 
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new basis consists of x 4 , y 2 . We solve the first equation for x 4 and 
substitute the resulting expression into the second equation and 
into F. The problem takes the form 

x 4 = 4 + 2xj - 2x 2 + 2x 3 - 7x 5 — y{\ 

y 2 = 1 - xi - x 2 + 4x 5 + y,/ (6) 

F=i— Xi— x 2 + 4x 5 + 2y t 

This completes the first step of the process. As a result we have 
succeeded in making the unknown y, nonbasic. 

In the new expression for F the coefficient of x t is negative. Looking 
at equations (6) we see that X! can be increased only to 1, y 2 then 
vanishing. The new basis consists of x 4 , Xj. On transforming equa- 
tions (6) and the expression for F (transforming the latter is now 
optimal, however) we have 

x 4 = 6 - 4x 2 + 2x 3 + x 5 + y t - 2y 2 

Xl = 1 - x 2 + 4x 5 + j>, - y 2 f (7) 

F = 3>i + yi 

Thus as a result of the second step the artificial unknowns y u y 2 have 
become nonbasic. Eliminating from equations (7) the terms having 

y\, yi, we get 

x 4 = 6 — 4x 2 + 2x 3 + x 5 1 

Xi — 1 — x 2 + 4x 5 j 

This means that we have separated a basis in the original system 
(4). Thus the problem is solved. 

As already noted, when applying the simplex method to finding 
the minimum of the function F equal to the sum of the artificial 
unknowns, it may happen that by the time the process is over (i.e. 
when min F = has already been attained) some of the artificial 
unknowns still make part of the basis. These unknowns can also 
be transformed into nonbasic ones by simple methods which we 
shall demonstrate using an example. 

Suppose, for example, that after a certain number of steps the 
problem has assumed the following form 



113 3 

x 2 = j ~ 2 Xl ~> Xi ~ 2 X * 



- 2 xs-^y 



y 2 = -x, - x 3 + 1 lx 4 + 5.x 5 + 2y, 

y 3 = 6x1 + 6x3 + 6x4 + 4x 5 + 2>'i 

F = 7.xj + 5x 3 + 17x 4 + 9x 5 + 5yj 



') 



(8) 
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We see that the function F has already attained the minimum 
equal to zero, it may therefore be omitted from further considera- 
tions. The unknowns y 2 and y 3 are still part of the basis. But 
the absolute terms in the equations for y 2 and y 3 are zero and not 
by chance, for min F = implies that in the resulting basic solution 
y 2 = and y 3 = 0. We now make use of this circumstance to make 
y 2 and y 3 leave the basis. To do this we observe that there is a 
negative number among the coefficients of the unknowns x lv .., x 5 
in the equation for y 2 : it is the coefficient — 1 of x 3 . We make 
the replacement x 3 ++ y 2 (we make the unknown x 3 basic and make 
y 2 become nonbasic). To do this we solve the second of the equations 
for x 3 and substitute the resulting expression for x 3 into the other 
equations. Since the absolute term in the second equation is zero, as a 
result of such an operation the. absolute terms in the equations 
will remain unchanged (and hence nonnegative). 

We get: 

I 5 3 

■(; = i- .v, -t- I5x 4 -t- 7.\' 5 -I- y, - i' 2 * 

o ? ? 

x 3 = a, t I1.X4+ 5.\-5 + 2.v, - y 2 ( (9) 

y } = 12.x, -4- 72x 4 + 34.x 5 + 14y, - 6y 2 

Now we have no negative coefficients (of x,,.... x 5 ) in the equation 
for y 3 , therefore we shall not be able to make y 3 nonbasic. But 
we should not be much annoyed at this. For if some numbers a,, 
..., x, satisfy the original system of constraints, then v,, y 2 and y 3 
must be zero. Thus 

12x, + 72x 4 + 34x 5 = 

Since here all the coefficients of the unknowns have the same 
sign, this must yield 

X, = .V 4 = X 5 =0 

these equalities are thus consequences of the original system of 
constraints and the conditions x, ^ (/' — 1,..., 5). If we regard them 
as satisfied the system (9) reduces to 

f 

So subject to the nonnegativity of the unknowns the given system 
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of constraints allows only one solution: 

\_ 

2 



x 2 = ^, x 3 — 0, Xj =0, x 4 = 0, x 5 = 



14. The Duality Theorem 
in Linear Programming 

There are so-called duality theorems in various branches of mathe- 
matics. Each of them allows the constructing for any statement 
in a given theory, according to a certain standard rule, of another 
statement in such a way that the validity of the first statement 
automatically leads to the validity of the second. A remarkable 
example of a duality theorem is met in linear programming too. 

Suppose a certain linear programming problem is given; we shall 
call it the original problem, or problem A, below. The constraints 
are given in the form of inequalities. So we have the system 

a n x, -I- «i2*2 + - + o in x„ + bi ^0" 

a 21 x, +a 22 x 2 + ... + a 2n x„ + b 2 ^0 ^ ^ 

flmi*i + a m2 x 2 + ... + a mn x n + b m ^ 0^ 
of m linear inequalities in n unknowns and a linear function 

/= <?!*! + C 2 X Z + ... + C„X„ 

We must pick from all nonnegative solutions (x t ^ 0, x 2 > 0,..., 
x n > 0) such that the function /attains the largest value (fis maximized). 

We connect with problem A another problem which we call a dual 
problem relative to problem A or problem A'. It is stated as follows: 
given the system 

0i i)>i + 021^2 + - + a ml y m + c, sS 

012^1 + 022>'2 + - + 0m2y„, + C 2 ^ 

(1') 

0i„) ; i + 02„>'2 + - + a m „y m + c„ < 

of n linear inequalities in m unknowns and the linear function 

<P = &i)'i + b 2 y 2 + ... + b m y„, 

It is necessary to pick all nonnegative solutions of the system (1') 
such that the function <p attains the smallest value possible (cp 
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is minimized). Comparing problems A and A' we notice: 

1. That the coefficient of the y'th unknown in the rth equation 
of the system (1') is the same as that of the ith unknowns in the jth 
equation of the system (1); 

2. That the absolute terms of the inequalities in each of the prob- 
lems coincide with the coefficients of the unknowns in the linear 
function of the other problem; 

3. That in the system of inequalities of problem A the inequalities 
are all of the > type, it being required in the problem that the 
maximum off should be attained. On the contrary, in the system of 
inequalities of problem A' the inequalities are all of the < type, 
but in return it is required in it that the minimum of cp should 
be attained. 

One of the main theorems in linear programming, the so-called 
duality theorem, states the following. 

Duality theorem. If an original problem is solvable, so is its dual, 
the maximum of the function f being equal to the minimum of the 
function cp: 

max f=min<p 

We shall prove this theorem by reducing it to the question 
of compatibility of a certain system of inequalities. 

To make the proof more convenient to follow, we break it down 
into several stages. 

Stage 1. Lemma. // x?,..., x° n is some nonneqative solution of the 
system (1) and y",..., y^ is some nonnegative solution of the system 
(1'), then for these solutions the values of the functions f and <p are 
connected by the inequality 

/o<<Po 

Proof. We consider the inequalities of the system (1) where the 
values x?,..., x° n are substituted for x lv .., x n . We multiply the first of 
the inequalities by y\, the second by y°, etc., and then add all the 
inequalities obtained: 

(fl n y?x? + ... + a mn y° m x° n ) + fc l3 /? + ... + b m y° m >0 

(one should bear in mind that we are multiplying the inequalities 
by nonnegative numbers, therefore the signs of the inequalities 
remain unchanged). In the same way, we multiply the first inequal- 
ity of the system (1') by x°, the second by x°, etc., and then add 
the resulting inequalities together: 

(a, iy ?x? + ... + a,„„y°x°) + c,x? + ... + c„x° n ^ 
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In both cases the brackets contain an expression equal to a sum 
of terms of the form ayyfxj over all i= 1,..., m, j= I,..., n. Hence 

the two expressions in brackets coincide. But then 

c ,*? + ... + c n x° n ^b l y° l +... + b m y° 

or f < (p . Thus the lemma is proved. 

Stage 2. Reducing problems A and A' to the solution of a certain 
system of inequalities. 

Consider the following "combined" system of inequalities: 



fl n .x, + ... + a,„.\-„ 


+ />, >0 


a wl .xi + ... +a,„„x„ 


+ h m > 




«l l.l'l + - + (Imli'm + t'l < 




«i n .l'i + ... + a„,„y,„ + c„ < 


CiXi + ... + c„x„ 


-&i.Vi - ... - >W.i. >0 



(S) 



It is seen that it is made up of the system (1), the system 
(1') and the inequality /'- <p > 0. The unknowns of the system 
(S) are x,,..„ x„, y,,..., )■•„, (there are n+m unknowns in all). 
We first of all establish the following fact. 

If the system (S) has nonneyative solution x?,..., x°, >?,..., y°, then 
the numbers x°,..., x" giw « solution to problem A a/it/ r/ie numbers 
yl, y° m a solution to problem A', w/f/i / = (p . 

We shall linger on this proposition a little longer to emphasize 
the principal role it plays. What is remarkable about it is that 
a linear programming problem, i.e. a maximization problem, reduces to 
solving a certain system of linear inequalities without any maximiza- 
tion requirements. In fact, the solution of the system (S) (in the 
range of nonnegative values of unknowns) is of course not a bit 
easier than the solution of the original linear programming problem 
(problem A); however, the very possibility of such a reduction is 
very curious. 

Now we prove the above statement. First of all, it is clear that 
the numbers x?,..., x°„ are nonnegative and satisfy the system (1 ); simi- 
larly the numbers y°,..., y° are nonnegative and satisfy (1'). More- 
over, these numbers satisfy the inequality 
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(following from the last inequality of the system (S)). On the 
other hand, by lemma we have 

/o<<Po 

Hence, / = <Po- 

Further, if x lv .., x n is some nonnegative solution of the system (1), 
then by the lemma we again have 

Comparing this and f = (p we get /</ . whence it follows that 
f is the maximal value of/ 

Similarly, if y ,,..., y m is some nonnegative solution of the system 
(1'), then by the lemma we have 

comparing this and f = <p we get cp ^ (p, i. e. <p is the minimal 
value of cp. This proves the above proposition. 

Stage 3. Completing the proof. Now it remains for us to show 
the following: if problem A has a solution, then the system (S) has a 
nonnegative solution. For then, as shown above, f = <p , i.e. 
max /= min (p. 

We shall argue following the rule of contraries, i.e. we shall 
suppose that the system (S) has no nonnegative solutions. For this 
case we have the corollary of the theorem on incompatible systems 
(Section 9). True, this corollary refers to a system consisting of 
inequalities of the >0 type and our system (S) has inequalities 
of the < type. But this is easy to mend by writing the system 
(S) in the form 



(S') 



a n .x, + ... + a u x„ 


+ b:^0 


a ml x, + ... + a m „x n 


+ b m >0 




- a u yi - ... - a nl y m - c, Ss 




- auyi - - ~ <* m „y m - c„ > 


c l x 1 + ... + c„x„ 


— b.y, — ... — b i» SO 



So suppose that the system (S') has no nonnegative solutions. 
According to the corollary of the theorem on incompatible systems, 
there will occur nonnegative numbers k ,,..., k m , l lt ..., /„, s'(m + n + \ 
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numbers all in all) such that* 

a t ,/c, + ... + a, nl k m + CiS ^ 0'"\ 

fl„,/c, + ... + a mn k u + c„s<0j 
- a lx l x - ... - a x J„ - b x s < 0" 



(2) 



(2') 



- a mX l x - ... - a m „l„ - b,„s < 0J 

b x k x + ... + b m k m - c x l x - ... - c„l„ < (3) 

We first of all show that the number s is nonzero. Indeed, suppose 
this is not the case, i.e. that s = 0. Consider some nonnegative 
solution x?,..., x° n of the system (1). Arguing in the same way as we 
did in proving the lemma, we find that 

(a x x k x x° x + ... + a mn k m x° n ) + b x k x + ... + b,„k m ^ 

But the parenthesis ^ (this results if we multiply the first inequality 
of (2) by x?, the second by x° and so on, bearing in mind s = 0, and 
then carry out addition). Hence 

b x k x + ... + b m k m ^ (4) 

after which it follows from (3) that 

c,/, +... + c„l„>0 

Further, by multiplying inequalities (2) (where s = 0) by an arbitrary 
positive number X we get 

a xx Xl x + ... + a Xn Xl„ #5 

(5) 

a ml Xl x + ... + a mn kl„ > 

If we now add to each inequality of (1), where x,,..., x„ are 
substituted for by x?,..., x°, the corresponding inequality of (5), we 
find that the numbers 

x? + *./„..., x n ° + kl„ 



* The numbers k ,,..., k m , /,,..., / , s are precisely those numbers by which 
we multiply the first, second, ..., (m + n + l)th inequalities of the system 
(S') to get (after addition) the inconsistent inequality a,x, + ... + a„x„ + 

+ «',_r, + ... + a',.,y,., + d > 0. where a a„. «',,..., a' m *S and d is a negative 

number. 
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also constitute a nonnegative solution of the system (1). For this 
solution the value of the function / is 

tv*? + ... + c n x° n + Ji(c,/, + ... + c„l„) 

and since the parenthesis is strictly positive, the value of /increases 
indefinitely with X. This means that max / = oc, i.e. that problem A, 
contrary to the premises, has no solution. 

Thus s is nonzero. It then follows from (2) that the numbers 
/c,/s,..., kjs are a nonnegative solution of the system (1), from 
(2') that the numbers /,/s,..., IJs are a nonnegative solution of 
the system (1'), and from (3) that for these solutions cp — f<0. 
But this is contrary to the lemma. So on supposing that the system (S) 
has no nonnegative solutions, we come to a contradiction. Such 
solutions are therefore certain to exist, which proves the duality 
theorem. 

Example. Find the maximal value of the function 

/= 2x 2 + 12x 3 

provided the variables a,, x 2 , x 3 are nonnegative and satisfy the 
inequalities 

Xi - x 2 - x 3 + 2 ^ 1 

-x, - x 2 -4x 3 + 1 S?0 ) 

Solution. Let us call the set problem problem A. The dual problem 
(problem A') must be stated as follows: find the minimal value of 
the function 

(p = 2v, + v, 

provided the variables V|, .is are nonnegative and satisfy the inequali- 
ties 

->'i- y 2 +2<0 > (6) 

-y, -4>' 2 + 12<0 J 

Problem A' can be solved graphically by representing in the 
yiOy>2 coordinate plane the feasible region of the system (6). This 
is done in Fig. 48. It is seen from the same figure that the 
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Fig. 48 



function (p attains its smallest value at the point (0,3), one of 
the vertices of the region. This value is equal to 3. By the duality 
theorem the maximum of the function / must also be equal to 3. 

15. Transportation Problem 

In Section 12 we have considered a number of specific linear prog- 
ramming problems. Of special interest among them is the transpor- 
tation problem, above all due to its practical significance. There 
is voluminous literature devoted to this and similar problems. One 
must say that the methods of solving the transportation problem 
are rather instructive. They demonstrate the indubitable fact that when 
solving any special class of problems general methods (say the 
simplex method) should be employed with caution, i.e. one should 
consider in full measure the peculiarities of the given class of 
problems. 

1°. Stating the problem. We remind the reader how the transpor- 
tation problem is stated in the general form. There are some, say 
m, source points (suppliers) 

Ai, A2,..., A m 

and so many, say n, destination points (consumers) 

B\, B 2 ,.-., B n 

We use a; to denote the quantity of goods (say in tons) concentrated 
at point A,{i= 1, 2,..., m) and b f to denote the quantity of goods 
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expected at point B, (/ = *» 2,.»> «)• We assume the condition 

a t +a 2 + - + a,„ = b x + b 2 + ... + b„ 

implying that the total stock of goods is equal to the summed 
demand for it. In addition to the numbers a h bj, we are also given 
quantities c i} denoting the cost of transporting a ton of 
goods from point A t to point By It is required to develop 
an optimal shipping schedule, i.e. to compute what quantity of goods 
must be shipped from each source point to each destination point 
for the total cost of shipments to be minimal. 

So our problem has mn nonnegative unknown numbers x t j(i = 1, 
..., m; j = 1,..., n) where x u is the quantity of goods to be shipped 
from A ; to Bj. Lest we should complicate the things with cumber- 
some expressions, we take specific values for m and n, namely, 
m = 3 and n = 4. So we shall assume that there are three source 
points, A t , A 2 , A$, and four destination points, B,, B 2 , B 3 , B 4 . The 
unknown quantities x i} can be summarized in a table called the 
transportation table: 

Table 1 



^^\^ Destina- 
^\^ tion 

Source^!™' 
point ^\ 


To Bi 


To B 2 


To B 3 


To B 4 


Stocks 


From A l 


*n 


*U 


*13 


x 14 


"\ 


From A i 


*21 


*2 2 


*23 


x 24 


ai 


From A 3 


*31 


*32 


*33 


x 34 


ay 


Requirements 


*1 


b 2 


hy 


fc 4 





Since the total weight of the goods shipped from A { to all 
consumption points must be equal to a,, we have the relation 

*U +*12 +*13 + x 14 = fl l 

Similar relations must hold for the points A 2 and A 3 . The 
unknowns of our problem must therefore satisfy the equations 

x 2 i+x 22 + x 2 ^+x 24 = a 2 } (!) 

X3 1 + x 32 + x 33 + x 34 . = a 3 

108 




(2) 



But we should also bear in mind that the total quantity of 
goods delivered to B x from all source points must be equal to b lt i.e. 

*11 + x 2i + x 3l = b\ 

Similar relations must hold for the points B 2 , B 3 , B A . This leads 
to the equations 

*11 + *21 + *3i =^1 
■Xl2+X 22 + X 32 = &2 

-X'i4 + X 2 4 + X34 

Notice that equations (I) and (2) are very easy to remember. 
Indeed, the ith equation of the system (1) implies that the sum 
of the unknowns in the /th row of the transportation table is 
equal to a,.; we shall call equations (1) horizontal for this reason. 
Similarly, the /th equation of the system (2) records the fact that 
the sum of the unknowns in the ;'th column of the transportation 
table is equal to ft.; because of this we shall call the equations 
of the system (2) vertical. 

We ship x tj tons of goods from point A { to point B,, the cost 
of transporting one ton being c ir Hence transportation from A- t to 
B t costs CjjXjj and the total cost of transportation will be 

S = -Lc ijXil (3) 

where the symbol X put before < ,v, signifies that the quantities 

ij 
CfjXjj must be summed over al! / = I. 2, 3. and all j — 1, 2, 3, 4 (there 

will be 12 summands in all). 

We thus come to the following linear programming problem. 

Given the system of equations (1), (2) and the linear function 
(3). Find among the nonnecjative solutions of the system such that 
minimizes the function (3). 

The transportation problem can be solved by the simplex method 
like any other linear programming problem. Because of the special 
structure of the system of constraints (1), (2) the general procedure 
of the simplex method is, of course, greatly simplified when applied 
to the transportation problem. Here we present a method for solving 
the transportation problem called the method of potentials. It is a vari- 
ant of the simplex method specially adapted for solving the transpor- 
tation problem. 

2°. Finding the first basis. As we know, the work by the simplex 
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method is preceded by a preparatory stage, that of finding the first 
basis. In the case of the transportation problem there is a very 
simple and convenient method of finding the first basis called the 
northwest corner rule. The essence of the method is best explained 
by considering a specific example. Suppose we are given three source 
points, A u A 2 , A 3 , and four destination points, B,, B 2 , B 3 , B 4 , the 
stocks and requirements being equal to the following quantities: 

fl , = 60, a 2 = 80, a 3 = 100 

b x =40, b 2 = 60, 6 3 = 80, fc 4 = 60 

These data are tabulated in Table 2 below. 



Table 2 





Si 


B 2 


*s 


s 4 


Stocks 


A, 


40 








60 


Az 










80 


A, 










100 


Requirements 


40 


60 


80 


60 





Let us try to satisfy the requirements of the first destination 
point B, usjng the stocks of the first source point A x . This can 
be done in this case since the stocks a { = 60 are greater than the 
requirements b { = 40. 

We therefore enter the number 40 in the cell x n . The require- 
ments of the point />, will be found fully satisfied, and therefore 
the B, column may be temporarily excluded from consideration. It is 
now possible to consider that we have come to new Table 3 
which has three destination points, B 2 , B 3 , B 4 , and three source 
points, A u A 2 , As, the stocks at A x being a\ = 60 - 40 = 20. Note 
that in Table 3 the sum of all requirements is as before equal 
to the sum of all stocks. 

We apply the same method to Table 3 and try to satisfy the 
requirements b 2 = 60 of the point B 2 (it assumes the role of the 
first point in Table 3) using the stocks u\ = 20 of the point /!,. It 
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is obvious that we can satisfy these requirements only partially since 

b 2 > a[. 

Table 3 





B 2 


B 3 


B 4 




A x 


20 






20 


Az 








80 


A 3 








100 




60 


80 


60 





We enter the number 20, this being the maximum of what can 
be transported from A x to B 2 , in the cell x X2 . The requirements 
of B 2 will be reduced to b 2 ' = 40 and the stocks of A x will be found 
fully exhausted. In virtue of this the A x column of Table 3 may be 
temporarily removed. Thus we come to Table 4 which has only two 
source points, A 2 and A 3 , and three destination points, B 2 , B 3 , B 4 , 
now. 

Table 4 





B 2 


B, 


B 4 




A 2 


40 






80 


Ai 








100 




40 


80 


60 





In a similar way we continue to reduce successively the resulting 
tables until we satisfy the requirements of all the destination points. 
In virtue of the condition of the problem all the stocks of the 
source points will be found exhausted*. 

We get the following values for some of the unknowns in the 



* When "new" stocks are equal to "new" requirements, either the row or 
the column may be excluded at will from the table. 

Ill 



course of reducing the tables: 

x, i = 40, x, 2 = 20, x 22 = 40, x 23 = 40, x 33 = 40, 

x 34 = 60 ' 4 ) 

On entering them in Table 2 we get Table 5. 



Table 5 





Bi 


B 2 


B> 


B 4 


Ai 


40 


20 






A 2 




40 


40 




A, 






40 


60 



Let us agree to refer to those cells in Table 5 which have the 
values of unknowns entered in them as basic, and to the remaining 
cells as vacant. If we consider that the values of the unknowns 
x,j- which correspond to the vacant cells are zero, then the result- 
ing set of all the unknowns yields the feasible solution of our 
problem. Indeed, it is easy to verify that the sum of the values 
of the unknowns in each row of the table is equal to the 
stocks of the corresponding source point and that in each column, 
to the requirements of the corresponding destination point. Therefore 
equations (1), (2) are satisfied. It now remains to remark that the 
values of all unknowns are nonnegative. 

In the general case, i. e. when there are any number m of source 
points and any number n of destination points, the method we have 
described allows us to fill m + n — 1 cell in the table. Indeed, in 
every step we fill exactly one cell, after which one row or one 
column is deleted from the table; there is one exception, where the 
table consists of a single cell on filling which we exclude at once 
both the row and the column. Since the number of all rows is m 
and the number of all columns is n, it is clear that the number 
of all steps and hence the number of filled (basic) cells is m + n — 1. 

We now show that the system of constraints (1), (2) can be solved 
for the unknowns corresponding to the basic cells. Hence it will follow 
that these unknowns may be assumed to be basic and the remaining 
unknowns corresponding to the vacant cells in the table to be non- 
basic. 

To prove this, we join the basic cells with a broken line in the order 
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they arose in the procedure described above. There will result a 
broken line of the following form for the example considered: 



•Xii X-n 

• — r 


x i3 


X i4 


x 2 , 


X 2Z 


' X 2 3 


x 2 + 


*31 


X 32 






X33 


X 3 <t 



It is not difficult to see now that the unknowns occupying the 
basic cells can be expressed in terms of the unknowns occupying 
the vacant cells. The expressions are found in consecutive order: 

taking the first vertical equation; 
taking the first horizontal equation; 
taking the second vertical equation; 
taking the second horizontal equation; 
taking the third vertical equation; 
finally for x 34 , taking the third horizontal (or the 
fourth vertical) equation. 

So we have found the basic set for our problem: 



first for 


*n» 


then for 


*12> 


then for 


X 22> 


then for 


*23> 


then for 


*33> 



X it , Xi2, *22> *23> X 33> *34 

This does not complete the solution of the set problem since 
the expressions for the basic unknowns in terms of the nonbasic 
ones still remain to be found. But these expressions will not be 
required in explicit form at the next stages of solving the transpor- 
tation problem. 

3°. Solving the problem by the method of potentials. The finding 
of the first basis is but a preparatory stage of solving the problem. 
When this stage is over, all the unknowns are found broken down 
into two groups: 

x u , basic unknowns, and x pq , nonbasic unknowns 

No actual expressions for the basic unknowns in terms of nonbasic 
ones will be needed. As to the function S (the total cost of 
transportation), it is obligatory to know its expression in terms of 
nonbasic unknowns. In other words, it is necessary to express the 
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function S as 

S=E s w*w + s (5) 

p. 1 

We shall show how to find coefficients s pq of nonbasic unknowns. 
We assign to each source point A t a certain value <x,(i = 1, 2,..., m), 
the "potential" of point A r Similarly, to each of the destination 
points Bj we assign a value p ; H=i, 2,..., «), the "potential" of 
point B-. We relate these values as follows: for every basic unknown 
x w we work out an equation 

a* + P/'= c w (6) 

where c kl is used as before to denote the cost of transporting 
a ton of goods from a point A k to a point B,. The set of the equa- 
tions of the form (6) worked out for all basic unknowns x kl forms 
a system of linear equations. This system has m + n — 1 equations 
(as many as there are basic unknowns) and m + n unknowns a t , p, 
(as many as there are source points and destination points taken 
together). It can be shown that this system is always compatible, 
it being possible to arbitrarily specify the value of one of the un- 
knowns and then unambiguously find the values of the remaining 
unknowns from the system. 

Let us fix some one solution (a lv .., a m , p lv .., P„) of the system of 
equations (6) and then calculate the sum a p + p^ for each nonbasic 
unknown x pr We denote this sum by c' pq : 

a P + P, = c'„ 

and call it indirect cost (in contrast to the real cost c ). It then 
turns out that in the expression (5) that interests us the coefficients 
of nonbasic unknowns are equal to 

s pq = c pq ~ c pq \ ') 

Formula (7) will be proved in the next section. 

If all the variables s are nonnegative, then the initial basic 
solution will be optimal. If, however, there are negative variables, 
say s , among them, then we go over to the next basis. It will 
be recalled that this step begins with reasoning as follows. We shall 
increase x (keeping the other nonbasic unknowns zero). If in 
doing so we reach a moment when one of the basic unknowns, 
say x k i , vanishes, we go over to a new basis by eliminating the 
unknown x. , from the old basis and introducing instead x 
Going over to the new basis completes one step of the simpfex 
method. 
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So far we have presented only some of the considerations ne- 
cessary for the understanding of the method of potentials. As 
to the actual solution of the problem, it can be best explained 
by considering a specific example. 

Example. We are given three source points, A u A 2 , A 3 , with the 
stocks 

a t = 60, a 2 = 80, a 3 = 100 
and four destination points, B u B 2 , B 3 , B 4 , having the requirements 

b x = 40, b 2 = 60, b 3 = 80, fe 4 = 60 

The values c {j (costs of transportation from A t to Bj per ton of 
goods) are given by Table 6. 

Table 6 



1 


2 


3 


4 


4 


3 


2 








2 


2 


1 



Solution. We begin with the finding of the first basic solution, 
[t this case the northwest corner rule leads to the result shown 
in Table 7 (cf. the example of the previous subsection). We denote 



Table 7 



40 


20 








40 


40 








40 


60 



this solution by X for short. The value of the function S is as 
Follows for it: 

I^tjXy =1x40 + 2x20 + 3x0 + 4x0 + 4x0 + 3x40 + 



+ 2x40 + 0x0 + 0x0 + 2x0 + 2x40+1x60 = 420 
To find the potentials it is necessary to solve the system of 
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equations 

a, + (3i = c,i = 1^ 
a, +p 2 = c, 2 = 2 
a 2 + p 2 = c 22 = 3 

«2 + Ps = c 23 = 2 
a 3 + p 3 = c 33 = 2 

<*3 + P4 = C 34 = 1 j 

any solution of this system suiting us. As already noted, the value of 
one of the unknowns can be specified arbitrarily. Setting a t = 1, we 
find successively: 

Pi = 0, p 2 =l, a, = 2, p 3 = 0, oc 3 = 2, p 4 =-l 
We then compute the indirect costs <■' : 

ci' 3 = a, +p 3 = i' 

f,' 4 = a, + p 4 = 0' 

c 21 = a 2 + p, = 2' 

c- 2 '4 = a 2 + P*= 1' 

<-'ii = »3 + Pi = 2' 

t'32 = a 3 + p, - 3' 



It is more convenient to carry out the above computation 
using Table 8 in which we first enter only the values of c kl for 
all the basic cells. Assuming at t = 1 and proceeding according to the 
above rule we compute the potentials a k and P, and, on entering 
them into the corresponding cells, we get Table 9. We then find the 
indirect costs c' • entering them in the corresponding cells we get 
Table 10. 

Table 8 



"^\ p 

1 ^\. 












1 


*> 










3 


9 










2 


1 
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Table 9 



^ p 

a 





1 





-1 


1 


1 


2 






2 




3 


2 




2 






2 


1 


Table 10 


«'"" P 





1 





-1 


1 


1 


i 


1 


0' 


2 


2' 


3 


2 


1' 


2 


2' 


3' 


2 


1 



In fact, the three elementary stages we have considered could be 
united into one. 
We now compute the differences s = c pq — c' pq . In this case 

s, 3 = 3-l'= 2, 
Sl4 = 4-0'= 4, 
s 21 =4-2'= 2, 
s 24 = - 1' = - 1, 
.s 31 =0-2'=-2, 
s 32 = 2 - 3' = - 1 

Hence the function S expressed in terms of nonbasic unknowns 
assumes the form 

S = 420 + 2x i3 + 4x, 4 + 2x 2i — x 24 — 2x 31 — x 32 (8) 

Among the coefficients of the unknowns in the right member there 
are negative ones, the coefficient x 3l , for example. It is therefore 
possible to decrease the value of S by increasing x 31 (while 
preserving the zero values of the remaining nonbasic unknowns). 
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We set x 3 , = p. Since the sums of the values of the unknowns in 
the rows and columns must remain unchanged, it is necessary to 
add p to or subtract it from the values of the basic unknowns 
in the following manner: 

Table 11 



40- p 
i — 


., 20+ P 






1 
1 


L^-i_ 


-1 




1 




j40-p 


60 







We had to compensate for the addition of p to x 3 , by subtracting 
p from x n and in turn to compensate for this by the addition of 
p to x 12 and so on until we came back to x 31 . 

We stop here to make a remark concerning Table 11. Going in the 
table from cell to cell in that sequence in which we compensate 
for p we get a closed broken line consisting of alternating horizontal 
and vertical links: the broken line is dotted in Table 11. One 
of the vertices of the broken line is in a nonbasic cell (x 31 in 
this case) and the rest are in basic cells (not necessarily in all of them; 
thus there is no vertex in the cell x 34 of Table 11). This broken 
line is called a cycle or, to be more exact, a recalculation cycle 
corresponding to a given nonbasic cell. 

As is seen from Table 11, the condition that the unknowns should 
be nonnegative allows p to be increased only to 40. We set p = 40; 
three basic unknowns, x u , x 22 and x 33 , then vanish together. We 
choose one of them, x 22 , for example. So we introduce the unknown 
x 3 , into the basis and make the unknown x 22 nonbasic. The new 
basic solution will be as follows: 



X 

2 






60 










80 




40 







60 



the value of the function S for it being 

420 - 2 x 40 = 340 
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(in (8) we set x 31 = p = 40 and assume the values of the remaining 
jinknowns to be zero). Going over to the new basis completes one 
Step in the procedure. We have succeeded in decreasing the value of 
the function S by 80 units. 

To sum up, by the beginning of the first step we had been 
given an initial basic solution X. The step itself consisted in going 

over to new basic solution X and included the following stages: 

(1) finding the potentials a k , p, and the indirect costs 

c' N = «, + p, 

(2) computing the differences s N = c - c' M ; 

(3) choosing a vacant cell corresponding to a negative difference 
s and constructing the recalculation cycle for this cell; 

(4) finding the new basic solution and the new value of the 
function S. 

Notice that had all the differences s proved nonnegative, that 
would have meant that the basic solution X was optimal Then 

stages (3), (4) would have become unnecessary. Thus the nonnegativity 
of all differences s is the criterion for terminating the procedure. 

Let us return to the example under consideration, however. The 
next step begins with finding the potentials, indirect costs and comput- 
ing the differences s . The corresponding computation will look as 
follows: 








1 


2 


1 


1 


1 


2 


3' 


2' 





0' 


r 


2 


r 








i' 


2 


i 



Sl3 = 3-3' = 


s 22 = 3-1' 


= 


2 


Sl4 = 4 - 2' = 2 


s 24 = o - r 


= 


-1 


s 21 =4-0' = 4 


s 32 = 2-1' 


= 


1 



S = 340 + 2jc, 4 + 4x 21 + 2x 22 - x 24 + x 32 
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There are negative differences among s pq : s 24 = — 1. We fix on 
the cell x 2 a and construct a recalculation cycle for it: 






60 










80 -p 


P 


40 




+ p 


60 - p 



We conclude from the examination of the cycle that p can be increased 
only to 60. Setting p = 60, we arrive at a new basic solution: 



x 

3 






60 










20 


60 


40 




60 





The value of the function S is 

340-1 x 60 = 280 
for this solution. Going over from X to X completes the second 

step in the procedure. 

The third step again begins with computing the potentials, indi- 
rect costs and differences s pq . We have 








1 


2 





1 


1 


2 


3' 


1' 





0' 


r 


2 











i' 


2 


0' 



Sl3 = 3-3' = s 22 = 3-l' = 2 
s, 4 = 4-l' = 3 s 32 = 2-l' = l 
s 21 = 4 - 0' = 4 s 34 = 1 - 0' = 1 
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Now the differences s /V( are all nonnegative. This means that the 
last basic solution X is optimal and the corresponding (smallest) 

value of the function S is 280. 

Thus the optimal solution of the problem has been found: 

( xi 2 = x 24 = x 33 = 60, x 23 = 20, x 31 =40; 

| the remaining x fj are zero. 
In conclusion we show once again, but now only schematically, 
the plan of solving the transportation problem: 



Finding the first basic solution 



Finding the potentials <x k , p, 



Computing the indirect costs c' 



Computing the differences 

s = c — c' 

>J L pq l pq 

(the coefficients of nonbasic unknowns in 
the expression for S) 



Choosing a negative difference s and 

constructing the recalculation cycle for 

the corresponding vacant cell 



Finding a new basis 



Note. If the differences s are all nonnegative, then the last basic 
solution is optimal. 

4°. Justifying the method of potentials. The formula 

S pq ~ C pq ~ C pq (') 

allowing the function S to be expressed in terms of nonbasic 
unknowns is the pivot of the solution method described above. 
Deriving this formula requires a deeper study of the transportation 
table and we have agreed to discuss it separately. We shall do 
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it now. To that end we return to the study of Table 11 

Table 11 



— i — 



-L 



20 +p 



AO-p 



I « J 4o-p 



i 40+ q 



60 



which contains the recalculation cycle for the cell x 31 . We used 
this table to find p and thereby go over to a new basic solution. 
But the table allows still another problem to be solved: it helps 
to determine what are the coefficients of the unknown x 31 in the 
expressions for the basic unknowns. 

We first of all make the following remark. If the values of nonbasic 
unknowns are indicated, then this unambiguously determines the 
values of the basic unknowns. But it is just Table 1 1 that gives 
an idea of what happens to the values of basic unknowns when 
the nonbasic unknown .\- 31 is assigned a value p (while assuming 
the remaining nonbasic unknowns to be zero). The study of the table 
shows that x 31 enters the expressions for the basic unknowns having 
the following coefficients: 




(9) 



In the remaining basic unknowns (namely, in x 34 ) x 31 has the 
coefficient 0. We see that when making the round of the cycle the 
coefficients involved alternatively assume the values + 1, — 1. 

It now remains to answer the question: What coefficient has 
x 3[ in the expression for the function S in terms of nonbasic 
unknowns? Well, this expression 

S = 420 + S| 3 x 13 + S14X14 + s 2 iX 2 i + s 24 x 2 4 + 



+ s 



31X31 



+ S,,X 



32-*32 



is produced when the basic unknowns in the original expression 
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for 5 

S = Z<yc tf (i=l,2, 3; j =1,2, 3, 4) 

are substituted for by their expressions in terms of nonbasic ones. 
In the given case it is necessary that x 11( x 12 , x 22 , *23> *33> X34 
should be substituted for by their expressions in terms of x 13 , x 14 , 
*2i> x 24 , x 31 , x 32 . In virtue of (9) the total coefficient of x 31 will 
be 

s 31 = c 31 — c ll + c 12 — c 22 + c 23 — C 33 

Hence 

*3i = C31 - (a, + P,) + (a, + 2 ) - (a 2 + p 2 ) + 

I +(a 2 + p 3 )-(a3 + P3) = C3 1 -(a 3 + p 1 ) 



or 



s 3 1 — c 3 1 ~ c i 1 



But that is just formula (7) (for the given case). The reasoning that 
has led us to the last equality is sufficiently demonstrative, and 
|here is no need to repeat it for the general case. 
% We conclude by saying a few words about other methods of solving 
$he transportation problem. The method of potentials discussed 
|(bove tends to be used in hand computation since one of its stages, 
namely that of constructing the recalculation cycle, is difficult to 
realize in the computer. With a small number of suppliers and 
consumers (within some ten) this method leads to an optimal solution 
ift a reasonable time. If, however, the number of suppliers and that 
bf consumers are large enough (and this is what happens in appli- 
cations, where these numbers are of an order of hundreds), resort- 
ing to a computer is inevitable. Algorithms computer programmes 
lite based on considerations other than those underlying the method 
idf potentials. The interested reader can find more about these 
jjSlgorithms in special literature devoted to the transportation 
iproblem. 
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